[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:33:24 dist-test-slave-chsk krb5kdc[5788](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:33:24 dist-test-slave-chsk krb5kdc[5788](info): set up 2 sockets
Aug 08 08:33:24 dist-test-slave-chsk krb5kdc[5788](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 08:33:25.720791 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.008s sys 0.013s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:33:25 dist-test-slave-chsk krb5kdc[5788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:33:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:33:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:33:25.922307 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:37755
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:36239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:37755
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:26.287945 5801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:26.288311 5801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:26.288403 5801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:26.295677 5801 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:26.295786 5801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:26.295833 5801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:26.295884 5801 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:26.295930 5801 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:26.306231 5801 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:36239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:37755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:37755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:26.308100 5801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:26.309859 5801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:26.327312 5806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:26.327283 5807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:26.327250 5809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:26.328274 5801 server_base.cc:1034] running on GCE node
I20260808 08:33:26.329291 5801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:26.331550 5801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:26.332772 5801 hybrid_clock.cc:648] HybridClock initialized: now 1786178006332685 us; error 79 us; skew 500 ppm
I20260808 08:33:26.333328 5801 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:26 dist-test-slave-chsk krb5kdc[5788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178006, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:26.337169 5801 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:33:26.339691 5801 webserver.cc:460] Webserver started at http://127.5.164.254:43035/ using document root <none> and password file <none>
I20260808 08:33:26.340765 5801 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:26.340915 5801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:26.341427 5801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:26.345451 5801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "f67ab1ccf9354853b9551f77bb49fb12"
format_stamp: "Formatted at 2026-08-08 08:33:26 on dist-test-slave-chsk"
server_key: "333c3cccf2c8f22596d68bcb6f921262"
server_key_iv: "42a15b926f46d8adb9fe14c63733b557"
server_key_version: "encryptionkey@0"
I20260808 08:33:26.346235 5801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "f67ab1ccf9354853b9551f77bb49fb12"
format_stamp: "Formatted at 2026-08-08 08:33:26 on dist-test-slave-chsk"
server_key: "333c3cccf2c8f22596d68bcb6f921262"
server_key_iv: "42a15b926f46d8adb9fe14c63733b557"
server_key_version: "encryptionkey@0"
I20260808 08:33:26.353978 5801 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260808 08:33:26.359375 5816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:26.361317 5801 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260808 08:33:26.361577 5801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "f67ab1ccf9354853b9551f77bb49fb12"
format_stamp: "Formatted at 2026-08-08 08:33:26 on dist-test-slave-chsk"
server_key: "333c3cccf2c8f22596d68bcb6f921262"
server_key_iv: "42a15b926f46d8adb9fe14c63733b557"
server_key_version: "encryptionkey@0"
I20260808 08:33:26.361783 5801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:26.387396 5801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:26.392437 5801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:26.392822 5801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:26.414963 5801 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:37755
I20260808 08:33:26.414995 5867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:37755 every 8 connection(s)
I20260808 08:33:26.417191 5801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:26.424027 5868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:26.424484 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 5801
I20260808 08:33:26.424989 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:33:26.428552 5779 external_mini_cluster.cc:1428] Setting key 191616e6d8e2d80fbcfca1e145b83848
I20260808 08:33:26.445425 5868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12: Bootstrap starting.
I20260808 08:33:26.452776 5868 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:26.454450 5868 log.cc:824] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:26.458217 5868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12: No bootstrap required, opened a new log
Aug 08 08:33:26 dist-test-slave-chsk krb5kdc[5788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:26.468123 5868 raft_consensus.cc:348] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f67ab1ccf9354853b9551f77bb49fb12" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37755 } }
I20260808 08:33:26.468634 5868 raft_consensus.cc:374] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:26.468844 5868 raft_consensus.cc:729] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f67ab1ccf9354853b9551f77bb49fb12, State: Initialized, Role: FOLLOWER
I20260808 08:33:26.470157 5868 consensus_queue.cc:260] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f67ab1ccf9354853b9551f77bb49fb12" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37755 } }
I20260808 08:33:26.470643 5868 raft_consensus.cc:388] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:26.470973 5868 raft_consensus.cc:482] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:26.471274 5868 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:26.474128 5868 raft_consensus.cc:504] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f67ab1ccf9354853b9551f77bb49fb12" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37755 } }
I20260808 08:33:26.475117 5868 leader_election.cc:302] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f67ab1ccf9354853b9551f77bb49fb12; no voters:
I20260808 08:33:26.476274 5868 leader_election.cc:288] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:33:26.476454 5873 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:26.480247 5868 sys_catalog.cc:564] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:26.480324 5871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:26.436753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42832 (local address 127.5.164.254:37755)
0808 08:33:26.439406 (+ 2653us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:26.439417 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:26.439462 (+ 45us) server_negotiation.cc:407] Connection header received
0808 08:33:26.453498 (+ 14036us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:26.453518 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:26.454074 (+ 556us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:26.454781 (+ 707us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:26.458582 (+ 3801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:26.460052 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:26.461839 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:26.462581 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:26.462882 (+ 301us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:26.469398 (+ 6516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:26.469460 (+ 62us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:26.469495 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:26.469537 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:26.473073 (+ 3536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:26.473951 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:26.473958 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:26.473964 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:26.474182 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:26.474710 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:26.474715 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:26.474722 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:26.475575 (+ 853us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:26.476057 (+ 482us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:26.477488 (+ 1431us) server_negotiation.cc:299] Negotiation successful
0808 08:33:26.478013 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2324,"thread_start_us":2039,"threads_started":1}
I20260808 08:33:26.480667 5873 raft_consensus.cc:686] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [term 1 LEADER]: Becoming Leader. State: Replica: f67ab1ccf9354853b9551f77bb49fb12, State: Running, Role: LEADER
I20260808 08:33:26.481544 5873 consensus_queue.cc:237] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f67ab1ccf9354853b9551f77bb49fb12" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37755 } }
I20260808 08:33:26.487526 5874 sys_catalog.cc:455] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f67ab1ccf9354853b9551f77bb49fb12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f67ab1ccf9354853b9551f77bb49fb12" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37755 } } }
I20260808 08:33:26.487555 5875 sys_catalog.cc:455] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f67ab1ccf9354853b9551f77bb49fb12. Latest consensus state: current_term: 1 leader_uuid: "f67ab1ccf9354853b9551f77bb49fb12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f67ab1ccf9354853b9551f77bb49fb12" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37755 } } }
I20260808 08:33:26.488054 5874 sys_catalog.cc:458] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:26.488130 5875 sys_catalog.cc:458] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:26.489777 5881 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:26.499054 5881 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:26.512276 5881 catalog_manager.cc:1347] Generated new cluster ID: e8934ff057e445e0bf56faf84f70ddbf
I20260808 08:33:26.512403 5881 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:26.527848 5881 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:33:26.529328 5881 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:26.540762 5881 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f67ab1ccf9354853b9551f77bb49fb12: Generated new TSK 0
I20260808 08:33:26.541747 5881 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:33:26.594137 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37755
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:36239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:26.937543 5894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:26.937875 5894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:26.938053 5894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:26.945505 5894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:26.945667 5894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:26.945844 5894 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:33:26.955747 5894 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:36239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37755
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:26.957118 5894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:26.958488 5894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:26.972712 5899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:26.972836 5900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:26.972694 5902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:26.973996 5894 server_base.cc:1034] running on GCE node
I20260808 08:33:26.974668 5894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:26.975718 5894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:26.976917 5894 hybrid_clock.cc:648] HybridClock initialized: now 1786178006976877 us; error 40 us; skew 500 ppm
I20260808 08:33:26.977245 5894 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:26 dist-test-slave-chsk krb5kdc[5788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178006, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:26.980852 5894 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:33:26.982679 5894 webserver.cc:460] Webserver started at http://127.5.164.193:34371/ using document root <none> and password file <none>
I20260808 08:33:26.983455 5894 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:26.983605 5894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:26.983937 5894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:26.986897 5894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "8e511a3b883040eda673be38e37d1994"
format_stamp: "Formatted at 2026-08-08 08:33:26 on dist-test-slave-chsk"
server_key: "335f49fef84888e30681f80c2a79e97b"
server_key_iv: "6d159c4e7d3eb1afedf3a0b299335d38"
server_key_version: "encryptionkey@0"
I20260808 08:33:26.987739 5894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "8e511a3b883040eda673be38e37d1994"
format_stamp: "Formatted at 2026-08-08 08:33:26 on dist-test-slave-chsk"
server_key: "335f49fef84888e30681f80c2a79e97b"
server_key_iv: "6d159c4e7d3eb1afedf3a0b299335d38"
server_key_version: "encryptionkey@0"
I20260808 08:33:26.993542 5894 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:33:26.997040 5911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:26.998355 5894 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260808 08:33:26.998541 5894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "8e511a3b883040eda673be38e37d1994"
format_stamp: "Formatted at 2026-08-08 08:33:26 on dist-test-slave-chsk"
server_key: "335f49fef84888e30681f80c2a79e97b"
server_key_iv: "6d159c4e7d3eb1afedf3a0b299335d38"
server_key_version: "encryptionkey@0"
I20260808 08:33:26.998754 5894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:27.021039 5894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:27.025512 5894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:27.025835 5894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:27.026989 5894 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:27.028761 5894 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:27.028865 5894 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:27.029081 5894 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:27.029165 5894 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:27.065163 5894 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:42789
I20260808 08:33:27.065186 6026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:42789 every 8 connection(s)
I20260808 08:33:27.066632 5894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:33:27.074185 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 5894
I20260808 08:33:27.074427 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:33:27.075035 5779 external_mini_cluster.cc:1428] Setting key 197563d4d262a2c92cabd2260053c351
Aug 08 08:33:27 dist-test-slave-chsk krb5kdc[5788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178006, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:27.089607 6029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:27.070045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:37101 (local address 127.5.164.254:37755)
0808 08:33:27.070533 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:27.070537 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:27.071466 (+ 929us) server_negotiation.cc:407] Connection header received
0808 08:33:27.073278 (+ 1812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:27.073284 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:27.073390 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:27.073510 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:27.075076 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:27.075854 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:27.077906 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:27.078680 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:27.078826 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:27.082695 (+ 3869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:27.082704 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:27.082711 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:27.082756 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:27.086284 (+ 3528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:27.086990 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:27.086998 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:27.087005 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:27.087177 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:27.087586 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:27.087594 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:27.087600 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:27.087989 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:27.088136 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:27.088856 (+ 720us) server_negotiation.cc:299] Negotiation successful
0808 08:33:27.089096 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":283,"threads_started":1}
I20260808 08:33:27.090333 6030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:27.070558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37755 (local address 127.5.164.193:37101)
0808 08:33:27.071313 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:27.071351 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:27.073006 (+ 1655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:27.073769 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:27.073777 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:27.074288 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:27.074913 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:27.074930 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:27.076074 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:27.076078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:27.077754 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:27.077766 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:27.078901 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:27.078906 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:27.079094 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:27.079894 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:27.079920 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:27.082487 (+ 2567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:27.086415 (+ 3928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:27.086422 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:27.086433 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:27.086870 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:27.087289 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:27.087293 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:27.087295 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:27.087473 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:27.088116 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:27.088121 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:27.088425 (+ 304us) client_negotiation.cc:769] Sending connection context
0808 08:33:27.088716 (+ 291us) client_negotiation.cc:240] Negotiation successful
0808 08:33:27.089090 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":281,"threads_started":1}
I20260808 08:33:27.091979 6027 heartbeater.cc:347] Connected to a master server at 127.5.164.254:37755
I20260808 08:33:27.092504 6027 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:27.093636 6027 heartbeater.cc:511] Master 127.5.164.254:37755 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
I20260808 08:33:27.097818 5833 ts_manager.cc:194] Registered new tserver with Master: 8e511a3b883040eda673be38e37d1994 (127.5.164.193:42789)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
I20260808 08:33:27.100486 5833 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:37101
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:33:27.122391 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37755
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:36239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:27.449997 6033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:27.450343 6033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:27.450519 6033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:27.457835 6033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:27.458011 6033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:27.458206 6033 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:33:27.468238 6033 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:36239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37755
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:27.469678 6033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:27.471009 6033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:27.484766 6042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:27.484887 6039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:27.484860 6040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:27.485891 6033 server_base.cc:1034] running on GCE node
I20260808 08:33:27.486567 6033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:27.487663 6033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:27.488909 6033 hybrid_clock.cc:648] HybridClock initialized: now 1786178007488848 us; error 60 us; skew 500 ppm
I20260808 08:33:27.489253 6033 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:27 dist-test-slave-chsk krb5kdc[5788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178007, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:27.492658 6033 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:33:27.494156 6033 webserver.cc:460] Webserver started at http://127.5.164.194:34921/ using document root <none> and password file <none>
I20260808 08:33:27.494810 6033 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:27.494915 6033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:27.495245 6033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:27.498145 6033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "b8a5c9c5f72b41f8b9576526aadcd4b4"
format_stamp: "Formatted at 2026-08-08 08:33:27 on dist-test-slave-chsk"
server_key: "c298309443395f095b6af2927eae7e72"
server_key_iv: "8507a5b5e60098ccfd3bec6a2f843277"
server_key_version: "encryptionkey@0"
I20260808 08:33:27.498853 6033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "b8a5c9c5f72b41f8b9576526aadcd4b4"
format_stamp: "Formatted at 2026-08-08 08:33:27 on dist-test-slave-chsk"
server_key: "c298309443395f095b6af2927eae7e72"
server_key_iv: "8507a5b5e60098ccfd3bec6a2f843277"
server_key_version: "encryptionkey@0"
I20260808 08:33:27.504187 6033 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:33:27.507682 6049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:27.509060 6033 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:33:27.509198 6033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "b8a5c9c5f72b41f8b9576526aadcd4b4"
format_stamp: "Formatted at 2026-08-08 08:33:27 on dist-test-slave-chsk"
server_key: "c298309443395f095b6af2927eae7e72"
server_key_iv: "8507a5b5e60098ccfd3bec6a2f843277"
server_key_version: "encryptionkey@0"
I20260808 08:33:27.509372 6033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:27.526188 6033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:27.530316 6033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:27.530561 6033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:27.531492 6033 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:27.532775 6033 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:27.532847 6033 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:27.532933 6033 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:27.532979 6033 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:27.567781 6033 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:41579
I20260808 08:33:27.567802 6169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:41579 every 8 connection(s)
I20260808 08:33:27.569166 6033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:33:27.571441 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 6033
I20260808 08:33:27.571661 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:33:27.572237 5779 external_mini_cluster.cc:1428] Setting key e8b21abe691375237140d8b854845458
Aug 08 08:33:27 dist-test-slave-chsk krb5kdc[5788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178007, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
I20260808 08:33:27.591171 6029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:27.571868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:44245 (local address 127.5.164.254:37755)
0808 08:33:27.572066 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:27.572070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:27.573727 (+ 1657us) server_negotiation.cc:407] Connection header received
0808 08:33:27.575892 (+ 2165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:27.575897 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:27.575990 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:27.576095 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:27.577582 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:27.578298 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:27.580083 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:27.580597 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:27.580702 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:27.585039 (+ 4337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:27.585045 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:27.585048 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:27.585083 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:27.587839 (+ 2756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:27.588661 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:27.588671 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:27.588674 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:27.588813 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:27.589311 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:27.589315 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:27.589317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:27.589618 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:27.589788 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:27.590517 (+ 729us) server_negotiation.cc:299] Negotiation successful
0808 08:33:27.590772 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:33:27.592290 6172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:27.572611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37755 (local address 127.5.164.194:44245)
0808 08:33:27.573528 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:27.573582 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:27.575630 (+ 2048us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:27.576332 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:27.576340 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:27.576860 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:27.577409 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:27.577425 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:27.578461 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:27.578466 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:27.579929 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:27.579946 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:27.580851 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:27.580859 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:27.581223 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:27.581962 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:27.582019 (+ 57us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:27.584784 (+ 2765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:27.588022 (+ 3238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:27.588032 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:27.588054 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:27.588520 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:27.588933 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:27.588938 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:27.588942 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:27.589172 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:27.589759 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:27.589768 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:27.590142 (+ 374us) client_negotiation.cc:769] Sending connection context
0808 08:33:27.590427 (+ 285us) client_negotiation.cc:240] Negotiation successful
0808 08:33:27.591047 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":363,"threads_started":1}
I20260808 08:33:27.593885 6170 heartbeater.cc:347] Connected to a master server at 127.5.164.254:37755
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
I20260808 08:33:27.594295 6170 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:27.595360 6170 heartbeater.cc:511] Master 127.5.164.254:37755 requested a full tablet report, sending...
I20260808 08:33:27.597168 5833 ts_manager.cc:194] Registered new tserver with Master: b8a5c9c5f72b41f8b9576526aadcd4b4 (127.5.164.194:41579)
I20260808 08:33:27.598462 5833 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:44245
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:33:27.618984 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37755
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:36239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:27.963490 6175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:27.963785 6175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:27.963884 6175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:27.971295 6175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:27.971407 6175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:27.971524 6175 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:33:27.981266 6175 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:36239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37755
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:27.982719 6175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:27.984131 6175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:27.997889 6184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:27.997859 6181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:27.998495 6180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:27.998778 6175 server_base.cc:1034] running on GCE node
I20260808 08:33:27.999614 6175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:28.000706 6175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:28.001904 6175 hybrid_clock.cc:648] HybridClock initialized: now 1786178008001833 us; error 71 us; skew 500 ppm
I20260808 08:33:28.002269 6175 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:28 dist-test-slave-chsk krb5kdc[5788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178008, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:28.005782 6175 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:33:28.007393 6175 webserver.cc:460] Webserver started at http://127.5.164.195:43013/ using document root <none> and password file <none>
I20260808 08:33:28.008080 6175 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:28.008226 6175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:28.008512 6175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:28.011650 6175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "e9e900759b5241019ce2049d065b9cd0"
format_stamp: "Formatted at 2026-08-08 08:33:28 on dist-test-slave-chsk"
server_key: "1fbfd6c7f1a20927a0eb7e47bc053f0a"
server_key_iv: "30a44ff8d8414b982f4b265db603b3d0"
server_key_version: "encryptionkey@0"
I20260808 08:33:28.012480 6175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "e9e900759b5241019ce2049d065b9cd0"
format_stamp: "Formatted at 2026-08-08 08:33:28 on dist-test-slave-chsk"
server_key: "1fbfd6c7f1a20927a0eb7e47bc053f0a"
server_key_iv: "30a44ff8d8414b982f4b265db603b3d0"
server_key_version: "encryptionkey@0"
I20260808 08:33:28.018016 6175 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 08:33:28.021495 6191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:28.022843 6175 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:33:28.023020 6175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "e9e900759b5241019ce2049d065b9cd0"
format_stamp: "Formatted at 2026-08-08 08:33:28 on dist-test-slave-chsk"
server_key: "1fbfd6c7f1a20927a0eb7e47bc053f0a"
server_key_iv: "30a44ff8d8414b982f4b265db603b3d0"
server_key_version: "encryptionkey@0"
I20260808 08:33:28.023312 6175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:28.055644 6175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:28.060333 6175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:28.060652 6175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:28.061669 6175 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:28.063097 6175 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:28.063220 6175 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 08:33:28.063340 6175 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:28.063387 6175 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:28.098368 6175 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:44417
I20260808 08:33:28.098460 6310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:44417 every 8 connection(s)
I20260808 08:33:28.099864 6175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:33:28.104363 6027 heartbeater.cc:503] Master 127.5.164.254:37755 was elected leader, sending a full tablet report...
I20260808 08:33:28.109802 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 6175
I20260808 08:33:28.110013 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:33:28.110636 5779 external_mini_cluster.cc:1428] Setting key 3595fceddb88230d8ac1546d962f1520
Aug 08 08:33:28 dist-test-slave-chsk krb5kdc[5788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178008, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:28.121008 6313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:28.102602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:53753 (local address 127.5.164.254:37755)
0808 08:33:28.103106 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:28.103112 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:28.104027 (+ 915us) server_negotiation.cc:407] Connection header received
0808 08:33:28.106089 (+ 2062us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:28.106097 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:28.106211 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:28.106331 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:28.107784 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:28.108551 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:28.110594 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:28.111055 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:28.111257 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:28.115425 (+ 4168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:28.115431 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:28.115434 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:28.115466 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:28.117955 (+ 2489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:28.118679 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:28.118686 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:28.118690 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:28.118811 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:28.119267 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:28.119272 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:28.119277 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:28.119546 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:28.119703 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:28.120386 (+ 683us) server_negotiation.cc:299] Negotiation successful
0808 08:33:28.120620 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":266,"threads_started":1}
I20260808 08:33:28.121932 6314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:28.103124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37755 (local address 127.5.164.195:53753)
0808 08:33:28.103853 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:28.103891 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:28.105763 (+ 1872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:28.106524 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:28.106532 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:28.107046 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:28.107640 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:28.107656 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:28.108682 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:28.108685 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:28.110451 (+ 1766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:28.110468 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:28.111359 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:28.111367 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:28.111686 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:28.112397 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:28.112435 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:28.115222 (+ 2787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:28.118097 (+ 2875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:28.118106 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:28.118122 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:28.118543 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:28.118924 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:28.118929 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:28.118933 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:28.119112 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:28.119674 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:28.119682 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:28.120030 (+ 348us) client_negotiation.cc:769] Sending connection context
0808 08:33:28.120293 (+ 263us) client_negotiation.cc:240] Negotiation successful
0808 08:33:28.120830 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":280,"threads_started":1}
I20260808 08:33:28.123353 6311 heartbeater.cc:347] Connected to a master server at 127.5.164.254:37755
I20260808 08:33:28.123615 6311 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:28.124298 6311 heartbeater.cc:511] Master 127.5.164.254:37755 requested a full tablet report, sending...
I20260808 08:33:28.125656 5833 ts_manager.cc:194] Registered new tserver with Master: e9e900759b5241019ce2049d065b9cd0 (127.5.164.195:44417)
I20260808 08:33:28.126765 5833 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:53753
I20260808 08:33:28.128206 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:33:28 dist-test-slave-chsk krb5kdc[5788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178008, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:33:28 dist-test-slave-chsk krb5kdc[5788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178008, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:33:28.176832 6319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:28.160952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43522 (local address 127.5.164.193:42789)
0808 08:33:28.161674 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:28.161685 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:28.161719 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:33:28.161819 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:28.161826 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:28.162125 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:28.162301 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:28.163875 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:28.165063 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:28.166443 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:28.167062 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:28.167250 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:28.171204 (+ 3954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:28.171216 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:28.171231 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:28.171265 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:28.174207 (+ 2942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:28.174875 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:28.174882 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:28.174884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:28.175007 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:28.175473 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:28.175476 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:28.175478 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:28.175826 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:28.176055 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:28.176334 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 08:33:28.176527 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":340,"threads_started":1}
W20260808 08:33:28.178270 5941 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43522
Aug 08 08:33:28 dist-test-slave-chsk krb5kdc[5788](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:33:28 dist-test-slave-chsk krb5kdc[5788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:33:28.226620 6319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:28.212719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43538 (local address 127.5.164.193:42789)
0808 08:33:28.212981 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:28.212990 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:28.213308 (+ 318us) server_negotiation.cc:407] Connection header received
0808 08:33:28.213491 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:28.213495 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:28.213585 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:28.213671 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:28.215117 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:28.215844 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:28.217013 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:28.217403 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:28.217491 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:28.221400 (+ 3909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:28.221405 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:28.221408 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:28.221444 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:28.224244 (+ 2800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:28.224858 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:28.224862 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:28.224864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:28.224991 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:28.225355 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:28.225359 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:28.225361 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:28.225636 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:28.225837 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:28.226076 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 08:33:28.226248 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:33:28.228713 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 5894
I20260808 08:33:28.241356 6319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:28.229789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43540 (local address 127.5.164.193:42789)
0808 08:33:28.229963 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:28.229968 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:28.230326 (+ 358us) server_negotiation.cc:407] Connection header received
0808 08:33:28.230452 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:28.230457 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:28.230515 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:28.230594 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:28.231829 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:28.232529 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:28.233768 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:28.234188 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:28.234281 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:28.236563 (+ 2282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:28.236568 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:28.236571 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:28.236601 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:28.239041 (+ 2440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:28.239730 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:28.239734 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:28.239736 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:28.239872 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:28.240200 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:28.240203 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:28.240205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:28.240466 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:28.240648 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:28.240896 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 08:33:28.241057 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:33:28.242285 6022 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:33:28.331400 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 5894
I20260808 08:33:28.350009 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 6033
Aug 08 08:33:28 dist-test-slave-chsk krb5kdc[5788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:33:28.367360 6326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:28.351105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43414 (local address 127.5.164.194:41579)
0808 08:33:28.351713 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:28.351721 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:28.351746 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:33:28.351814 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:28.351820 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:28.352021 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:28.352152 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:28.353432 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:28.354435 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:28.355900 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:28.356436 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:28.356536 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:28.360969 (+ 4433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:28.360981 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:28.360996 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:28.361034 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:28.364159 (+ 3125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:28.364975 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:28.364982 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:28.364985 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:28.365153 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:28.365573 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:28.365576 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:28.365578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:28.365986 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:28.366269 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:28.366658 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 08:33:28.366927 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":296,"threads_started":1}
I20260808 08:33:28.368754 6165 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:33:28.453279 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 6033
I20260808 08:33:28.474217 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 6175
Aug 08 08:33:28 dist-test-slave-chsk krb5kdc[5788](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:33:28.491775 6328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:28.475470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50502 (local address 127.5.164.195:44417)
0808 08:33:28.476216 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:28.476223 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:28.476261 (+ 38us) server_negotiation.cc:407] Connection header received
0808 08:33:28.476328 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:28.476334 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:28.476552 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:28.476695 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:28.478035 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:28.479113 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:28.480704 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:28.481373 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:28.481530 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:28.485878 (+ 4348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:28.485892 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:28.485907 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:28.485945 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:28.489084 (+ 3139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:28.489762 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:28.489769 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:28.489771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:28.489903 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:28.490270 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:28.490273 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:28.490275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:28.490624 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:28.490863 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:28.491272 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 08:33:28.491483 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":388,"threads_started":1}
I20260808 08:33:28.493091 6306 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:33:28.576849 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 6175
I20260808 08:33:28.597563 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 5801
I20260808 08:33:28.598814 5863 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:33:28.702301 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 5801
2026-08-08T08:33:28Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4147 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:33:28 dist-test-slave-chsk krb5kdc[6333](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:33:28 dist-test-slave-chsk krb5kdc[6333](info): set up 2 sockets
Aug 08 08:33:28 dist-test-slave-chsk krb5kdc[6333](info): commencing operation
krb5kdc: starting...
W20260808 08:33:29.831032 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.004s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:33:29 dist-test-slave-chsk krb5kdc[6333](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:33:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:33:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:33:30.032668 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:39745
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:33217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:39745
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:30.352653 6347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:30.352954 6347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:30.353134 6347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:30.360574 6347 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:30.360689 6347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:30.360798 6347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:30.360898 6347 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:30.360977 6347 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:30.371228 6347 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:33217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:39745
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:39745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:30.372619 6347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:30.373935 6347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:30.385491 6356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:30.385588 6353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:30.385536 6352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:30.386762 6347 server_base.cc:1034] running on GCE node
I20260808 08:33:30.387563 6347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:30.388936 6347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:30.390146 6347 hybrid_clock.cc:648] HybridClock initialized: now 1786178010390110 us; error 26 us; skew 500 ppm
I20260808 08:33:30.390446 6347 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:30 dist-test-slave-chsk krb5kdc[6333](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178010, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:30.393711 6347 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:33:30.395473 6347 webserver.cc:460] Webserver started at http://127.5.164.254:38393/ using document root <none> and password file <none>
I20260808 08:33:30.396225 6347 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:30.396337 6347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:30.396625 6347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:30.399914 6347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "a63dc894468541bcaa3922675923769a"
format_stamp: "Formatted at 2026-08-08 08:33:30 on dist-test-slave-chsk"
server_key: "78ab4865b93559b2f58121645f2027ef"
server_key_iv: "4526a651290f7745637bd0b62f6e126b"
server_key_version: "encryptionkey@0"
I20260808 08:33:30.400787 6347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "a63dc894468541bcaa3922675923769a"
format_stamp: "Formatted at 2026-08-08 08:33:30 on dist-test-slave-chsk"
server_key: "78ab4865b93559b2f58121645f2027ef"
server_key_iv: "4526a651290f7745637bd0b62f6e126b"
server_key_version: "encryptionkey@0"
I20260808 08:33:30.406509 6347 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 08:33:30.410292 6364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:30.411893 6347 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:33:30.412104 6347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "a63dc894468541bcaa3922675923769a"
format_stamp: "Formatted at 2026-08-08 08:33:30 on dist-test-slave-chsk"
server_key: "78ab4865b93559b2f58121645f2027ef"
server_key_iv: "4526a651290f7745637bd0b62f6e126b"
server_key_version: "encryptionkey@0"
I20260808 08:33:30.412303 6347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:30.432587 6347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:30.437073 6347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:30.437433 6347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:30.456933 6347 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:39745
I20260808 08:33:30.456964 6418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:39745 every 8 connection(s)
I20260808 08:33:30.458424 6347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:30.462020 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 6347
I20260808 08:33:30.462289 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:33:30.462742 6420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:30.463227 5779 external_mini_cluster.cc:1428] Setting key 5281624f931f7398dfab0b4e750a0dc5
I20260808 08:33:30.478312 6420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a: Bootstrap starting.
Aug 08 08:33:30 dist-test-slave-chsk krb5kdc[6333](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:30.481645 6420 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:30.482743 6420 log.cc:824] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:30.485890 6420 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a: No bootstrap required, opened a new log
I20260808 08:33:30.487283 6424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:30.465448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48758 (local address 127.5.164.254:39745)
0808 08:33:30.466339 (+ 891us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:30.466352 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:30.466398 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:33:30.468218 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:30.468244 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:30.468695 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:30.469072 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:30.471109 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:30.472476 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:30.474318 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:30.475032 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:30.475254 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:30.480033 (+ 4779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:30.480040 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:30.480054 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:30.480106 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:30.483246 (+ 3140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:30.483951 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:30.483966 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:30.483973 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:30.484131 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:30.484504 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:30.484509 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:30.484512 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:30.485034 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:30.485386 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:30.485847 (+ 461us) server_negotiation.cc:299] Negotiation successful
0808 08:33:30.486278 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":663,"thread_start_us":432,"threads_started":1}
I20260808 08:33:30.494829 6420 raft_consensus.cc:348] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a63dc894468541bcaa3922675923769a" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39745 } }
I20260808 08:33:30.495332 6420 raft_consensus.cc:374] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:30.495478 6420 raft_consensus.cc:729] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a63dc894468541bcaa3922675923769a, State: Initialized, Role: FOLLOWER
I20260808 08:33:30.496184 6420 consensus_queue.cc:260] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a63dc894468541bcaa3922675923769a" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39745 } }
I20260808 08:33:30.496511 6420 raft_consensus.cc:388] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:30.496697 6420 raft_consensus.cc:482] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:30.496888 6420 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:30.499374 6420 raft_consensus.cc:504] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a63dc894468541bcaa3922675923769a" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39745 } }
I20260808 08:33:30.499922 6420 leader_election.cc:302] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a63dc894468541bcaa3922675923769a; no voters:
I20260808 08:33:30.500700 6420 leader_election.cc:288] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:33:30.500829 6426 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:30.501583 6426 raft_consensus.cc:686] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [term 1 LEADER]: Becoming Leader. State: Replica: a63dc894468541bcaa3922675923769a, State: Running, Role: LEADER
I20260808 08:33:30.502269 6426 consensus_queue.cc:237] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a63dc894468541bcaa3922675923769a" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39745 } }
I20260808 08:33:30.503350 6420 sys_catalog.cc:564] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:30.505755 6427 sys_catalog.cc:455] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a63dc894468541bcaa3922675923769a. Latest consensus state: current_term: 1 leader_uuid: "a63dc894468541bcaa3922675923769a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a63dc894468541bcaa3922675923769a" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39745 } } }
I20260808 08:33:30.505728 6428 sys_catalog.cc:455] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a63dc894468541bcaa3922675923769a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a63dc894468541bcaa3922675923769a" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39745 } } }
I20260808 08:33:30.506618 6428 sys_catalog.cc:458] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:30.506613 6427 sys_catalog.cc:458] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:30.512779 6432 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:30.518569 6432 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:30.528374 6432 catalog_manager.cc:1347] Generated new cluster ID: 829cb52dc1b345d5a5033d3e73f3317c
I20260808 08:33:30.528517 6432 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:30.551533 6432 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:33:30.552912 6432 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:30.561031 6432 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a63dc894468541bcaa3922675923769a: Generated new TSK 0
I20260808 08:33:30.561865 6432 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:33:30.618366 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39745
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:33217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:30.953346 6449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:30.953624 6449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:30.953722 6449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:30.960893 6449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:30.960999 6449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:30.961119 6449 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:33:30.970590 6449 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:33217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39745
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:30.971879 6449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:30.973151 6449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:30.985850 6454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:30.985965 6455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:30.985821 6457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:30.986752 6449 server_base.cc:1034] running on GCE node
I20260808 08:33:30.987823 6449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:30.988844 6449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:30.990134 6449 hybrid_clock.cc:648] HybridClock initialized: now 1786178010990083 us; error 43 us; skew 500 ppm
I20260808 08:33:30.990497 6449 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:30 dist-test-slave-chsk krb5kdc[6333](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178010, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:30.993716 6449 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:33:30.995304 6449 webserver.cc:460] Webserver started at http://127.5.164.193:43275/ using document root <none> and password file <none>
I20260808 08:33:30.995994 6449 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:30.996145 6449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:30.996465 6449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:30.999606 6449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "f55761e28e134f5993cae2f5698ca093"
format_stamp: "Formatted at 2026-08-08 08:33:30 on dist-test-slave-chsk"
server_key: "d0dc16f172b3d399147115b576edee47"
server_key_iv: "652bcb4d60887ebcb96b8b06c1a2be8e"
server_key_version: "encryptionkey@0"
I20260808 08:33:31.000412 6449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "f55761e28e134f5993cae2f5698ca093"
format_stamp: "Formatted at 2026-08-08 08:33:30 on dist-test-slave-chsk"
server_key: "d0dc16f172b3d399147115b576edee47"
server_key_iv: "652bcb4d60887ebcb96b8b06c1a2be8e"
server_key_version: "encryptionkey@0"
I20260808 08:33:31.005658 6449 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 08:33:31.009065 6464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:31.010324 6449 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:33:31.010510 6449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "f55761e28e134f5993cae2f5698ca093"
format_stamp: "Formatted at 2026-08-08 08:33:30 on dist-test-slave-chsk"
server_key: "d0dc16f172b3d399147115b576edee47"
server_key_iv: "652bcb4d60887ebcb96b8b06c1a2be8e"
server_key_version: "encryptionkey@0"
I20260808 08:33:31.010718 6449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:31.039893 6449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:31.044116 6449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:31.044426 6449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:31.045418 6449 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:31.046764 6449 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:31.046872 6449 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:31.047029 6449 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:31.047106 6449 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:31.081693 6449 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:41659
I20260808 08:33:31.081754 6584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:41659 every 8 connection(s)
I20260808 08:33:31.083068 6449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:33:31.089812 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 6449
I20260808 08:33:31.090073 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:33:31.090761 5779 external_mini_cluster.cc:1428] Setting key faf63cdb5899f9b33e5b3f9f5cc7c46d
Aug 08 08:33:31 dist-test-slave-chsk krb5kdc[6333](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178010, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:31.103864 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:31.085786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:52677 (local address 127.5.164.254:39745)
0808 08:33:31.086411 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:31.086415 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:31.087191 (+ 776us) server_negotiation.cc:407] Connection header received
0808 08:33:31.089073 (+ 1882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:31.089078 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:31.089174 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:31.089295 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:31.091055 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:31.091851 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:31.093454 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:31.093852 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:31.093994 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:31.097597 (+ 3603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:31.097602 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:31.097605 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:31.097639 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:31.100335 (+ 2696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:31.101322 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:31.101326 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:31.101329 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:31.101459 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:31.101954 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:31.101957 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:31.101959 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:31.102229 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:31.102340 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:31.103317 (+ 977us) server_negotiation.cc:299] Negotiation successful
0808 08:33:31.103550 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":341,"threads_started":1}
I20260808 08:33:31.105521 6588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:31.086246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39745 (local address 127.5.164.193:52677)
0808 08:33:31.086979 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:31.087032 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:31.088794 (+ 1762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:31.089583 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:31.089591 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:31.090220 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:31.090852 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:31.090886 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:31.092020 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:31.092026 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:31.093294 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:31.093306 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:31.094089 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:31.094098 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:31.094350 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:31.095065 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:31.095087 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:31.097361 (+ 2274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:31.100493 (+ 3132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:31.100514 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:31.100532 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:31.101190 (+ 658us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:31.101572 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:31.101579 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:31.101585 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:31.101844 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:31.102367 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:31.102377 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:31.102846 (+ 469us) client_negotiation.cc:769] Sending connection context
0808 08:33:31.103192 (+ 346us) client_negotiation.cc:240] Negotiation successful
0808 08:33:31.103802 (+ 610us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":307,"threads_started":1}
I20260808 08:33:31.107187 6585 heartbeater.cc:347] Connected to a master server at 127.5.164.254:39745
I20260808 08:33:31.107510 6585 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:31.108232 6585 heartbeater.cc:511] Master 127.5.164.254:39745 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
I20260808 08:33:31.110433 6382 ts_manager.cc:194] Registered new tserver with Master: f55761e28e134f5993cae2f5698ca093 (127.5.164.193:41659)
I20260808 08:33:31.112159 6382 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:52677
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:33:31.136657 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39745
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:33217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:31.459874 6591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:31.460211 6591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:31.460377 6591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:31.467787 6591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:31.467931 6591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:31.468118 6591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:33:31.478055 6591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:33217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39745
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:31.479440 6591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:31.480794 6591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:31.494275 6596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:31.494261 6597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:31.494436 6599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:31.494987 6591 server_base.cc:1034] running on GCE node
I20260808 08:33:31.495697 6591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:31.496603 6591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:31.497833 6591 hybrid_clock.cc:648] HybridClock initialized: now 1786178011497790 us; error 40 us; skew 500 ppm
I20260808 08:33:31.498179 6591 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:31 dist-test-slave-chsk krb5kdc[6333](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178011, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:31.501324 6591 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:33:31.502795 6591 webserver.cc:460] Webserver started at http://127.5.164.194:32785/ using document root <none> and password file <none>
I20260808 08:33:31.503618 6591 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:31.503788 6591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:31.504102 6591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:31.507194 6591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "244e0c14e3df48b9823c923048410f22"
format_stamp: "Formatted at 2026-08-08 08:33:31 on dist-test-slave-chsk"
server_key: "1186442034d8e839185630cc8a1960de"
server_key_iv: "955a69e85d17b23aab190fc5663c9032"
server_key_version: "encryptionkey@0"
I20260808 08:33:31.508020 6591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "244e0c14e3df48b9823c923048410f22"
format_stamp: "Formatted at 2026-08-08 08:33:31 on dist-test-slave-chsk"
server_key: "1186442034d8e839185630cc8a1960de"
server_key_iv: "955a69e85d17b23aab190fc5663c9032"
server_key_version: "encryptionkey@0"
I20260808 08:33:31.513447 6591 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260808 08:33:31.517477 6606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:31.518802 6591 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260808 08:33:31.518986 6591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "244e0c14e3df48b9823c923048410f22"
format_stamp: "Formatted at 2026-08-08 08:33:31 on dist-test-slave-chsk"
server_key: "1186442034d8e839185630cc8a1960de"
server_key_iv: "955a69e85d17b23aab190fc5663c9032"
server_key_version: "encryptionkey@0"
I20260808 08:33:31.519258 6591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:31.542840 6591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:31.546828 6591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:31.547175 6591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:31.548205 6591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:31.549528 6591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:31.549600 6591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:31.549777 6591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:31.549829 6591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:31.582935 6591 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:40003
I20260808 08:33:31.582984 6724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:40003 every 8 connection(s)
I20260808 08:33:31.584296 6591 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:33:31.586179 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 6591
I20260808 08:33:31.586391 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:33:31.586932 5779 external_mini_cluster.cc:1428] Setting key 3bac6e0a1ef2c213327c1ae6a0334af4
Aug 08 08:33:31 dist-test-slave-chsk krb5kdc[6333](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178011, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:31.604707 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:31.586930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:36831 (local address 127.5.164.254:39745)
0808 08:33:31.587160 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:31.587167 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:31.588461 (+ 1294us) server_negotiation.cc:407] Connection header received
0808 08:33:31.590577 (+ 2116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:31.590582 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:31.590673 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:31.590806 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:31.592407 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:31.593128 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:31.594666 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:31.595422 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:31.595577 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:31.598893 (+ 3316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:31.598898 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:31.598901 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:31.598932 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:31.601500 (+ 2568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:31.602319 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:31.602326 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:31.602330 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:31.602459 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:31.602891 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:31.602898 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:31.602901 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:31.603219 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:31.603376 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:31.604123 (+ 747us) server_negotiation.cc:299] Negotiation successful
0808 08:33:31.604349 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 08:33:31.605708 6727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:31.587448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39745 (local address 127.5.164.194:36831)
0808 08:33:31.588281 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:31.588331 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:31.590282 (+ 1951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:31.591054 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:31.591063 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:31.591643 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:31.592226 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:31.592246 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:31.593278 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:31.593288 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:31.594519 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:31.594531 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:31.595637 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:31.595642 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:31.595858 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:31.596481 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:31.596502 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:31.598664 (+ 2162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:31.601641 (+ 2977us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:31.601650 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:31.601665 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:31.602195 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:31.602579 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:31.602584 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:31.602588 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:31.602778 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:31.603352 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:31.603360 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:31.603672 (+ 312us) client_negotiation.cc:769] Sending connection context
0808 08:33:31.604035 (+ 363us) client_negotiation.cc:240] Negotiation successful
0808 08:33:31.604553 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":310,"threads_started":1}
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
I20260808 08:33:31.607265 6725 heartbeater.cc:347] Connected to a master server at 127.5.164.254:39745
I20260808 08:33:31.607542 6725 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:31.608280 6725 heartbeater.cc:511] Master 127.5.164.254:39745 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
I20260808 08:33:31.609849 6382 ts_manager.cc:194] Registered new tserver with Master: 244e0c14e3df48b9823c923048410f22 (127.5.164.194:40003)
I20260808 08:33:31.611114 6382 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:36831
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:33:31.634305 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39745
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:33217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:31.955552 6730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:31.955845 6730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:31.955942 6730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:31.963120 6730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:31.963253 6730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:31.963368 6730 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:33:31.973145 6730 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:33217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39745
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:31.974402 6730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:31.975732 6730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:31.988560 6738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:31.988663 6735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:31.988641 6736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:31.989496 6730 server_base.cc:1034] running on GCE node
I20260808 08:33:31.990094 6730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:31.991024 6730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:31.992224 6730 hybrid_clock.cc:648] HybridClock initialized: now 1786178011992166 us; error 58 us; skew 500 ppm
I20260808 08:33:31.992570 6730 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:31 dist-test-slave-chsk krb5kdc[6333](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178011, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:31.998872 6730 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:33:32.000497 6730 webserver.cc:460] Webserver started at http://127.5.164.195:37941/ using document root <none> and password file <none>
I20260808 08:33:32.001188 6730 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:32.001353 6730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:32.001696 6730 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:32.004940 6730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "3d06e1d962854c779fe5b5cd67bb9d9a"
format_stamp: "Formatted at 2026-08-08 08:33:31 on dist-test-slave-chsk"
server_key: "2836e638262fe4cb785cea0984a91689"
server_key_iv: "2436c6a4690f15ddfd560ad8b848c727"
server_key_version: "encryptionkey@0"
I20260808 08:33:32.005774 6730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "3d06e1d962854c779fe5b5cd67bb9d9a"
format_stamp: "Formatted at 2026-08-08 08:33:31 on dist-test-slave-chsk"
server_key: "2836e638262fe4cb785cea0984a91689"
server_key_iv: "2436c6a4690f15ddfd560ad8b848c727"
server_key_version: "encryptionkey@0"
I20260808 08:33:32.010818 6730 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 08:33:32.014318 6745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:32.015858 6730 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:33:32.016027 6730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "3d06e1d962854c779fe5b5cd67bb9d9a"
format_stamp: "Formatted at 2026-08-08 08:33:31 on dist-test-slave-chsk"
server_key: "2836e638262fe4cb785cea0984a91689"
server_key_iv: "2436c6a4690f15ddfd560ad8b848c727"
server_key_version: "encryptionkey@0"
I20260808 08:33:32.016265 6730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:32.048703 6730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:32.052917 6730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:32.053218 6730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:32.054214 6730 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:32.056169 6730 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:32.056290 6730 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 08:33:32.056428 6730 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:32.056502 6730 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:32.097911 6730 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:45293
I20260808 08:33:32.098006 6865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:45293 every 8 connection(s)
I20260808 08:33:32.099383 6730 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:33:32.103480 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 6730
I20260808 08:33:32.103727 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:33:32.104367 5779 external_mini_cluster.cc:1428] Setting key 021ccc120c05cee15276c023ae833ca3
I20260808 08:33:32.115880 6585 heartbeater.cc:503] Master 127.5.164.254:39745 was elected leader, sending a full tablet report...
Aug 08 08:33:32 dist-test-slave-chsk krb5kdc[6333](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178011, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:32.125236 6868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.102993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39745 (local address 127.5.164.195:52045)
0808 08:33:32.103933 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:32.103982 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:32.106213 (+ 2231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:32.106947 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:32.106958 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:32.107724 (+ 766us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:32.108510 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:32.108532 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.109557 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.109564 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:32.111579 (+ 2015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:32.111598 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.112824 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.112830 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:32.113116 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.113926 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:32.113958 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:32.117138 (+ 3180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:32.121072 (+ 3934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:32.121081 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:32.121095 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:32.121651 (+ 556us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:32.121995 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:32.122000 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:32.122003 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:32.122254 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:32.122806 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:32.122814 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:32.123211 (+ 397us) client_negotiation.cc:769] Sending connection context
0808 08:33:32.123481 (+ 270us) client_negotiation.cc:240] Negotiation successful
0808 08:33:32.123955 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":337,"threads_started":1}
I20260808 08:33:32.126401 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.102501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:52045 (local address 127.5.164.254:39745)
0808 08:33:32.102703 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:32.102709 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:32.104127 (+ 1418us) server_negotiation.cc:407] Connection header received
0808 08:33:32.106450 (+ 2323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:32.106455 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:32.106576 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:32.106683 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:32.108659 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.109403 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.111789 (+ 2386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.112583 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.112739 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.117417 (+ 4678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:32.117423 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:32.117431 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:32.117473 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:32.120954 (+ 3481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:32.121765 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:32.121768 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:32.121770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:32.121889 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:32.122368 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:32.122371 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:32.122373 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:32.122673 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:32.122838 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:32.125877 (+ 3039us) server_negotiation.cc:299] Negotiation successful
0808 08:33:32.126080 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 08:33:32.130882 6866 heartbeater.cc:347] Connected to a master server at 127.5.164.254:39745
I20260808 08:33:32.131287 6866 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:32.132148 6866 heartbeater.cc:511] Master 127.5.164.254:39745 requested a full tablet report, sending...
I20260808 08:33:32.133664 6382 ts_manager.cc:194] Registered new tserver with Master: 3d06e1d962854c779fe5b5cd67bb9d9a (127.5.164.195:45293)
I20260808 08:33:32.134464 6382 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:52045
I20260808 08:33:32.145020 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:33:32.164479 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.151960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48768 (local address 127.5.164.254:39745)
0808 08:33:32.152170 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:32.152180 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:32.152704 (+ 524us) server_negotiation.cc:407] Connection header received
0808 08:33:32.152845 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:32.152849 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:32.152914 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:32.152997 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:32.154463 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.155215 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.156451 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.156855 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.156949 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.159344 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:32.159349 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:32.159352 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:32.159385 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:32.161810 (+ 2425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:32.162485 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:32.162489 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:32.162491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:32.162642 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:32.162963 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:32.162967 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:32.162969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:32.163460 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:32.163651 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:32.163953 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 08:33:32.164123 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:33:32.173681 6382 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48768:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:33:32.181844 6382 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:33:32.233762 6880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.198094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:45293 (local address 127.0.0.1:37920)
0808 08:33:32.205365 (+ 7271us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:32.205417 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:32.205697 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:32.222263 (+ 16566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:32.222275 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:32.222318 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:32.223414 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:32.223438 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.226387 (+ 2949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.226393 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:32.229222 (+ 2829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:32.229234 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.232011 (+ 2777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.232018 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:32.232362 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.232442 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 08:33:32.232734 (+ 292us) client_negotiation.cc:240] Negotiation successful
0808 08:33:32.233016 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6883,"thread_start_us":6645,"threads_started":1}
I20260808 08:33:32.233851 6881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.198447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37920 (local address 127.5.164.195:45293)
0808 08:33:32.221094 (+ 22647us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:32.221107 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:32.221279 (+ 172us) server_negotiation.cc:407] Connection header received
0808 08:33:32.221410 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:32.221422 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:32.221826 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:32.223237 (+ 1411us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:32.223880 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.226257 (+ 2377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.229423 (+ 3166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.231718 (+ 2295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.231896 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.232184 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:32.232909 (+ 725us) server_negotiation.cc:299] Negotiation successful
0808 08:33:32.233213 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20532,"thread_start_us":20692,"threads_started":1}
I20260808 08:33:32.238831 6885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.198871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:40003 (local address 127.0.0.1:58206)
0808 08:33:32.220138 (+ 21267us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:32.220166 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:32.220343 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:32.225849 (+ 5506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:32.225854 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:32.225899 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:32.227240 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:32.227251 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.229945 (+ 2694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.229950 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:32.233349 (+ 3399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:32.233377 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.237983 (+ 4606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.237988 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:32.238153 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.238178 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:33:32.238256 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 08:33:32.238347 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21001,"mutex_wait_us":5,"thread_start_us":24945,"threads_started":1}
I20260808 08:33:32.239179 6883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.199742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58206 (local address 127.5.164.194:40003)
0808 08:33:32.225105 (+ 25363us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:32.225113 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:32.225140 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:33:32.225237 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:32.225243 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:32.225572 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:32.225770 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:32.227625 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.229763 (+ 2138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.233623 (+ 3860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.237649 (+ 4026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.237863 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.238183 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:32.238369 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 08:33:32.238625 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25175,"thread_start_us":24840,"threads_started":1}
I20260808 08:33:32.240584 6882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.211316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:41659 (local address 127.0.0.1:40178)
0808 08:33:32.224481 (+ 13165us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:32.224503 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:32.224647 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:32.225299 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:32.225316 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:32.225341 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:32.226906 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:32.226923 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.229718 (+ 2795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.229723 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:32.233269 (+ 3546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:32.233287 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.239392 (+ 6105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.239398 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:32.239569 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.239593 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:33:32.239702 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 08:33:32.239830 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12943,"mutex_wait_us":64,"thread_start_us":9143,"threads_started":1}
I20260808 08:33:32.240628 6884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.206071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40178 (local address 127.5.164.193:41659)
0808 08:33:32.222361 (+ 16290us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:32.222374 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:32.224765 (+ 2391us) server_negotiation.cc:407] Connection header received
0808 08:33:32.224916 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:32.224922 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:32.225087 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:32.225349 (+ 262us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:32.227258 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.229569 (+ 2311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.233586 (+ 4017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.235631 (+ 2045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.235821 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.236273 (+ 452us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:32.239758 (+ 3485us) server_negotiation.cc:299] Negotiation successful
0808 08:33:32.239977 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16016,"thread_start_us":16363,"threads_started":1}
I20260808 08:33:32.241058 6796 tablet_service.cc:1467] Processing CreateTablet for tablet 690f235e1f35484db15ba23593c8a9ab (DEFAULT_TABLE table=test-table [id=c1177b8819a9402b90a1dc4d455160e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:32.243358 6796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 690f235e1f35484db15ba23593c8a9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:32.243795 6657 tablet_service.cc:1467] Processing CreateTablet for tablet 690f235e1f35484db15ba23593c8a9ab (DEFAULT_TABLE table=test-table [id=c1177b8819a9402b90a1dc4d455160e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:32.244621 6516 tablet_service.cc:1467] Processing CreateTablet for tablet 690f235e1f35484db15ba23593c8a9ab (DEFAULT_TABLE table=test-table [id=c1177b8819a9402b90a1dc4d455160e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:32.245450 6657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 690f235e1f35484db15ba23593c8a9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:32.246025 6516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 690f235e1f35484db15ba23593c8a9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:32.264000 6886 tablet_bootstrap.cc:492] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093: Bootstrap starting.
I20260808 08:33:32.266847 6888 tablet_bootstrap.cc:492] T 690f235e1f35484db15ba23593c8a9ab P 244e0c14e3df48b9823c923048410f22: Bootstrap starting.
I20260808 08:33:32.270462 6887 tablet_bootstrap.cc:492] T 690f235e1f35484db15ba23593c8a9ab P 3d06e1d962854c779fe5b5cd67bb9d9a: Bootstrap starting.
I20260808 08:33:32.272794 6886 tablet_bootstrap.cc:654] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:32.273523 6888 tablet_bootstrap.cc:654] T 690f235e1f35484db15ba23593c8a9ab P 244e0c14e3df48b9823c923048410f22: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:32.274838 6887 tablet_bootstrap.cc:654] T 690f235e1f35484db15ba23593c8a9ab P 3d06e1d962854c779fe5b5cd67bb9d9a: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:32.275679 6886 log.cc:824] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:32.275678 6888 log.cc:824] T 690f235e1f35484db15ba23593c8a9ab P 244e0c14e3df48b9823c923048410f22: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:32.276633 6887 log.cc:824] T 690f235e1f35484db15ba23593c8a9ab P 3d06e1d962854c779fe5b5cd67bb9d9a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:32.281340 6888 tablet_bootstrap.cc:492] T 690f235e1f35484db15ba23593c8a9ab P 244e0c14e3df48b9823c923048410f22: No bootstrap required, opened a new log
I20260808 08:33:32.281592 6886 tablet_bootstrap.cc:492] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093: No bootstrap required, opened a new log
I20260808 08:33:32.281791 6888 ts_tablet_manager.cc:1397] T 690f235e1f35484db15ba23593c8a9ab P 244e0c14e3df48b9823c923048410f22: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.008s
I20260808 08:33:32.282002 6886 ts_tablet_manager.cc:1397] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093: Time spent bootstrapping tablet: real 0.018s user 0.014s sys 0.000s
I20260808 08:33:32.283038 6887 tablet_bootstrap.cc:492] T 690f235e1f35484db15ba23593c8a9ab P 3d06e1d962854c779fe5b5cd67bb9d9a: No bootstrap required, opened a new log
I20260808 08:33:32.283419 6887 ts_tablet_manager.cc:1397] T 690f235e1f35484db15ba23593c8a9ab P 3d06e1d962854c779fe5b5cd67bb9d9a: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.003s
I20260808 08:33:32.293309 6888 raft_consensus.cc:348] T 690f235e1f35484db15ba23593c8a9ab P 244e0c14e3df48b9823c923048410f22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d06e1d962854c779fe5b5cd67bb9d9a" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 45293 } } peers { permanent_uuid: "244e0c14e3df48b9823c923048410f22" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 40003 } } peers { permanent_uuid: "f55761e28e134f5993cae2f5698ca093" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 41659 } }
I20260808 08:33:32.293845 6888 raft_consensus.cc:374] T 690f235e1f35484db15ba23593c8a9ab P 244e0c14e3df48b9823c923048410f22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:32.294050 6888 raft_consensus.cc:729] T 690f235e1f35484db15ba23593c8a9ab P 244e0c14e3df48b9823c923048410f22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244e0c14e3df48b9823c923048410f22, State: Initialized, Role: FOLLOWER
I20260808 08:33:32.294901 6888 consensus_queue.cc:260] T 690f235e1f35484db15ba23593c8a9ab P 244e0c14e3df48b9823c923048410f22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d06e1d962854c779fe5b5cd67bb9d9a" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 45293 } } peers { permanent_uuid: "244e0c14e3df48b9823c923048410f22" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 40003 } } peers { permanent_uuid: "f55761e28e134f5993cae2f5698ca093" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 41659 } }
I20260808 08:33:32.297098 6725 heartbeater.cc:503] Master 127.5.164.254:39745 was elected leader, sending a full tablet report...
I20260808 08:33:32.298799 6886 raft_consensus.cc:348] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d06e1d962854c779fe5b5cd67bb9d9a" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 45293 } } peers { permanent_uuid: "244e0c14e3df48b9823c923048410f22" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 40003 } } peers { permanent_uuid: "f55761e28e134f5993cae2f5698ca093" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 41659 } }
I20260808 08:33:32.299589 6886 raft_consensus.cc:374] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:32.299750 6886 raft_consensus.cc:729] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f55761e28e134f5993cae2f5698ca093, State: Initialized, Role: FOLLOWER
I20260808 08:33:32.300114 6888 ts_tablet_manager.cc:1428] T 690f235e1f35484db15ba23593c8a9ab P 244e0c14e3df48b9823c923048410f22: Time spent starting tablet: real 0.018s user 0.011s sys 0.007s
I20260808 08:33:32.300292 6887 raft_consensus.cc:348] T 690f235e1f35484db15ba23593c8a9ab P 3d06e1d962854c779fe5b5cd67bb9d9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d06e1d962854c779fe5b5cd67bb9d9a" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 45293 } } peers { permanent_uuid: "244e0c14e3df48b9823c923048410f22" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 40003 } } peers { permanent_uuid: "f55761e28e134f5993cae2f5698ca093" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 41659 } }
I20260808 08:33:32.300896 6887 raft_consensus.cc:374] T 690f235e1f35484db15ba23593c8a9ab P 3d06e1d962854c779fe5b5cd67bb9d9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:32.300678 6886 consensus_queue.cc:260] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d06e1d962854c779fe5b5cd67bb9d9a" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 45293 } } peers { permanent_uuid: "244e0c14e3df48b9823c923048410f22" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 40003 } } peers { permanent_uuid: "f55761e28e134f5993cae2f5698ca093" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 41659 } }
I20260808 08:33:32.301069 6887 raft_consensus.cc:729] T 690f235e1f35484db15ba23593c8a9ab P 3d06e1d962854c779fe5b5cd67bb9d9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d06e1d962854c779fe5b5cd67bb9d9a, State: Initialized, Role: FOLLOWER
I20260808 08:33:32.302098 6887 consensus_queue.cc:260] T 690f235e1f35484db15ba23593c8a9ab P 3d06e1d962854c779fe5b5cd67bb9d9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d06e1d962854c779fe5b5cd67bb9d9a" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 45293 } } peers { permanent_uuid: "244e0c14e3df48b9823c923048410f22" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 40003 } } peers { permanent_uuid: "f55761e28e134f5993cae2f5698ca093" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 41659 } }
I20260808 08:33:32.303553 6886 ts_tablet_manager.cc:1428] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093: Time spent starting tablet: real 0.021s user 0.019s sys 0.004s
I20260808 08:33:32.305787 6895 raft_consensus.cc:482] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:32.306308 6895 raft_consensus.cc:504] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d06e1d962854c779fe5b5cd67bb9d9a" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 45293 } } peers { permanent_uuid: "244e0c14e3df48b9823c923048410f22" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 40003 } } peers { permanent_uuid: "f55761e28e134f5993cae2f5698ca093" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 41659 } }
I20260808 08:33:32.308743 6866 heartbeater.cc:503] Master 127.5.164.254:39745 was elected leader, sending a full tablet report...
I20260808 08:33:32.309144 6887 ts_tablet_manager.cc:1428] T 690f235e1f35484db15ba23593c8a9ab P 3d06e1d962854c779fe5b5cd67bb9d9a: Time spent starting tablet: real 0.026s user 0.014s sys 0.011s
I20260808 08:33:32.311035 6895 leader_election.cc:288] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d06e1d962854c779fe5b5cd67bb9d9a (127.5.164.195:45293), 244e0c14e3df48b9823c923048410f22 (127.5.164.194:40003)
I20260808 08:33:32.325204 6883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.311891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:58347 (local address 127.5.164.194:40003)
0808 08:33:32.312245 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:32.312254 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:32.315927 (+ 3673us) server_negotiation.cc:407] Connection header received
0808 08:33:32.316182 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:32.316186 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:32.316245 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:32.316324 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:32.317605 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.318931 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.322541 (+ 3610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.323806 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.324006 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.324116 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:32.324626 (+ 510us) server_negotiation.cc:299] Negotiation successful
0808 08:33:32.324786 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260808 08:33:32.325282 6881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.311632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:47731 (local address 127.5.164.195:45293)
0808 08:33:32.312102 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:32.312108 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:32.315086 (+ 2978us) server_negotiation.cc:407] Connection header received
0808 08:33:32.315422 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:32.315430 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:32.315572 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:32.315719 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:32.317054 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.318549 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.322472 (+ 3923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.324095 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.324243 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.324299 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:32.324785 (+ 486us) server_negotiation.cc:299] Negotiation successful
0808 08:33:32.324937 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284}
I20260808 08:33:32.325585 6897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.313036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:40003 (local address 127.5.164.193:58347)
0808 08:33:32.315792 (+ 2756us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:32.315811 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:32.316037 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:32.316411 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:32.316417 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:32.316449 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:32.317419 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:32.317431 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.319172 (+ 1741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.319177 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:32.322392 (+ 3215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:32.322406 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.324120 (+ 1714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.324129 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:32.324424 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.324473 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 08:33:32.324586 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 08:33:32.324733 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2594,"thread_start_us":977,"threads_started":1}
I20260808 08:33:32.325695 6898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.311791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:45293 (local address 127.5.164.193:47731)
0808 08:33:32.314986 (+ 3195us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:32.315006 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:32.315225 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:32.315739 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:32.315744 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:32.315785 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:32.316867 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:32.316883 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.318691 (+ 1808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.318694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:32.322268 (+ 3574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:32.322290 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.324389 (+ 2099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.324395 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:32.324608 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.324643 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 08:33:32.324729 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 08:33:32.324852 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2948,"thread_start_us":3361,"threads_started":1}
I20260808 08:33:32.327263 6677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "690f235e1f35484db15ba23593c8a9ab" candidate_uuid: "f55761e28e134f5993cae2f5698ca093" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244e0c14e3df48b9823c923048410f22" is_pre_election: true
I20260808 08:33:32.328106 6677 raft_consensus.cc:2454] T 690f235e1f35484db15ba23593c8a9ab P 244e0c14e3df48b9823c923048410f22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f55761e28e134f5993cae2f5698ca093 in term 0.
I20260808 08:33:32.329128 6466 leader_election.cc:302] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244e0c14e3df48b9823c923048410f22, f55761e28e134f5993cae2f5698ca093; no voters:
I20260808 08:33:32.329607 6895 raft_consensus.cc:2781] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:32.329826 6895 raft_consensus.cc:482] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:32.330001 6895 raft_consensus.cc:3037] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:32.330291 6816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "690f235e1f35484db15ba23593c8a9ab" candidate_uuid: "f55761e28e134f5993cae2f5698ca093" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d06e1d962854c779fe5b5cd67bb9d9a" is_pre_election: true
I20260808 08:33:32.330981 6816 raft_consensus.cc:2454] T 690f235e1f35484db15ba23593c8a9ab P 3d06e1d962854c779fe5b5cd67bb9d9a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f55761e28e134f5993cae2f5698ca093 in term 0.
I20260808 08:33:32.333745 6895 raft_consensus.cc:504] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d06e1d962854c779fe5b5cd67bb9d9a" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 45293 } } peers { permanent_uuid: "244e0c14e3df48b9823c923048410f22" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 40003 } } peers { permanent_uuid: "f55761e28e134f5993cae2f5698ca093" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 41659 } }
I20260808 08:33:32.334626 6895 leader_election.cc:288] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [CANDIDATE]: Term 1 election: Requested vote from peers 3d06e1d962854c779fe5b5cd67bb9d9a (127.5.164.195:45293), 244e0c14e3df48b9823c923048410f22 (127.5.164.194:40003)
I20260808 08:33:32.335247 6816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "690f235e1f35484db15ba23593c8a9ab" candidate_uuid: "f55761e28e134f5993cae2f5698ca093" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d06e1d962854c779fe5b5cd67bb9d9a"
I20260808 08:33:32.335394 6677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "690f235e1f35484db15ba23593c8a9ab" candidate_uuid: "f55761e28e134f5993cae2f5698ca093" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244e0c14e3df48b9823c923048410f22"
I20260808 08:33:32.335610 6816 raft_consensus.cc:3037] T 690f235e1f35484db15ba23593c8a9ab P 3d06e1d962854c779fe5b5cd67bb9d9a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:32.335700 6677 raft_consensus.cc:3037] T 690f235e1f35484db15ba23593c8a9ab P 244e0c14e3df48b9823c923048410f22 [term 0 FOLLOWER]: Advancing to term 1
W20260808 08:33:32.335693 6586 tablet.cc:2369] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:33:32.336530 6726 tablet.cc:2369] T 690f235e1f35484db15ba23593c8a9ab P 244e0c14e3df48b9823c923048410f22: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:33:32.339592 6677 raft_consensus.cc:2454] T 690f235e1f35484db15ba23593c8a9ab P 244e0c14e3df48b9823c923048410f22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f55761e28e134f5993cae2f5698ca093 in term 1.
I20260808 08:33:32.339579 6816 raft_consensus.cc:2454] T 690f235e1f35484db15ba23593c8a9ab P 3d06e1d962854c779fe5b5cd67bb9d9a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f55761e28e134f5993cae2f5698ca093 in term 1.
I20260808 08:33:32.340099 6467 leader_election.cc:302] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 244e0c14e3df48b9823c923048410f22, 3d06e1d962854c779fe5b5cd67bb9d9a, f55761e28e134f5993cae2f5698ca093; no voters:
I20260808 08:33:32.340516 6895 raft_consensus.cc:2781] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:32.340989 6895 raft_consensus.cc:686] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [term 1 LEADER]: Becoming Leader. State: Replica: f55761e28e134f5993cae2f5698ca093, State: Running, Role: LEADER
I20260808 08:33:32.341536 6895 consensus_queue.cc:237] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d06e1d962854c779fe5b5cd67bb9d9a" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 45293 } } peers { permanent_uuid: "244e0c14e3df48b9823c923048410f22" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 40003 } } peers { permanent_uuid: "f55761e28e134f5993cae2f5698ca093" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 41659 } }
I20260808 08:33:32.346777 6382 catalog_manager.cc:5495] T 690f235e1f35484db15ba23593c8a9ab P f55761e28e134f5993cae2f5698ca093 reported cstate change: term changed from 0 to 1, leader changed from <none> to f55761e28e134f5993cae2f5698ca093 (127.5.164.193). New cstate: current_term: 1 leader_uuid: "f55761e28e134f5993cae2f5698ca093" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d06e1d962854c779fe5b5cd67bb9d9a" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 45293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244e0c14e3df48b9823c923048410f22" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 40003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f55761e28e134f5993cae2f5698ca093" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 41659 } health_report { overall_health: HEALTHY } } }
W20260808 08:33:32.351511 6867 tablet.cc:2369] T 690f235e1f35484db15ba23593c8a9ab P 3d06e1d962854c779fe5b5cd67bb9d9a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 08:33:32 dist-test-slave-chsk krb5kdc[6333](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:33:32.370626 6884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.354842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40190 (local address 127.5.164.193:41659)
0808 08:33:32.355007 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:32.355011 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:32.355807 (+ 796us) server_negotiation.cc:407] Connection header received
0808 08:33:32.356043 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:32.356048 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:32.356120 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:32.356223 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:32.357759 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.358536 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.359873 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.360343 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.360480 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.364579 (+ 4099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:32.364591 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:32.364606 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:32.364639 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:32.367667 (+ 3028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:32.368398 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:32.368405 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:32.368408 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:32.368579 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:32.368976 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:32.368980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:32.368982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:32.369359 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:32.369693 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:32.370000 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 08:33:32.370280 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 08 08:33:32 dist-test-slave-chsk krb5kdc[6333](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178012, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:33:32 dist-test-slave-chsk krb5kdc[6333](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178012, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:33:32.422034 6884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.408175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40192 (local address 127.5.164.193:41659)
0808 08:33:32.408442 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:32.408449 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:32.408712 (+ 263us) server_negotiation.cc:407] Connection header received
0808 08:33:32.408877 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:32.408881 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:32.408947 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:32.409038 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:32.410517 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.411327 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.412629 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.413004 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.413092 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.417148 (+ 4056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:32.417153 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:32.417157 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:32.417190 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:32.419540 (+ 2350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:32.420157 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:32.420161 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:32.420164 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:32.420303 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:32.420685 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:32.420688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:32.420690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:32.420950 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:32.421203 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:32.421465 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 08:33:32.421635 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
Aug 08 08:33:32 dist-test-slave-chsk krb5kdc[6333](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:33:32 dist-test-slave-chsk krb5kdc[6333](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:33:32.481274 6884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.460863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40196 (local address 127.5.164.193:41659)
0808 08:33:32.461112 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:32.461120 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:32.461483 (+ 363us) server_negotiation.cc:407] Connection header received
0808 08:33:32.461650 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:32.461654 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:32.461740 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:32.461825 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:32.464458 (+ 2633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.465265 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.467592 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.468166 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.468265 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.475232 (+ 6967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:32.475239 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:32.475242 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:32.475278 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:32.478403 (+ 3125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:32.479132 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:32.479135 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:32.479179 (+ 44us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:32.479374 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:32.479714 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:32.479717 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:32.479719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:32.480098 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:32.480364 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:32.480537 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 08:33:32.480738 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260808 08:33:32.483474 6494 tablet_service.cc:2908] Rejecting scan request for tablet 690f235e1f35484db15ba23593c8a9ab: Uninitialized: clean time has not yet been initialized
I20260808 08:33:32.487388 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 6449
I20260808 08:33:32.502221 6884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.488440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40200 (local address 127.5.164.193:41659)
0808 08:33:32.488664 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:32.488669 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:32.488827 (+ 158us) server_negotiation.cc:407] Connection header received
0808 08:33:32.489026 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:32.489031 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:32.489101 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:32.489203 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:32.490742 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.491510 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.492774 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.493315 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.493463 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.496625 (+ 3162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:32.496630 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:32.496633 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:32.496662 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:32.499417 (+ 2755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:32.500085 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:32.500093 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:32.500098 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:32.500216 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:32.500616 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:32.500622 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:32.500625 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:32.500910 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:32.501191 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:32.501487 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 08:33:32.501772 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 08:33:32.502967 6580 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:33:32.597815 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 6449
I20260808 08:33:32.618383 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 6591
Aug 08 08:33:32 dist-test-slave-chsk krb5kdc[6333](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:33:32.634832 6883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.619212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58214 (local address 127.5.164.194:40003)
0808 08:33:32.619403 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:32.619410 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:32.619511 (+ 101us) server_negotiation.cc:407] Connection header received
0808 08:33:32.619744 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:32.619752 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:32.619925 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:32.620119 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:32.621557 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.622382 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.624232 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.624640 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.624784 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.628857 (+ 4073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:32.628871 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:32.628887 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:32.628921 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:32.631969 (+ 3048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:32.632665 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:32.632673 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:32.632675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:32.632806 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:32.633207 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:32.633211 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:32.633213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:32.633596 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:32.633962 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:32.634261 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 08:33:32.634494 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:33:32.635609 6718 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:33:32.723868 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 6591
I20260808 08:33:32.744179 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 6730
Aug 08 08:33:32 dist-test-slave-chsk krb5kdc[6333](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:33:32.758859 6881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:32.744967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37922 (local address 127.5.164.195:45293)
0808 08:33:32.745193 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:32.745203 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:32.745225 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:33:32.745285 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:32.745288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:32.745351 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:32.745438 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:32.746694 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.747515 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.748875 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:32.749293 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:32.749388 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:32.753683 (+ 4295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:32.753698 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:32.753714 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:32.753753 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:32.756625 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:32.757201 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:32.757208 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:32.757211 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:32.757340 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:32.757665 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:32.757668 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:32.757670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:32.758019 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:32.758232 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:32.758446 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 08:33:32.758602 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260808 08:33:32.759619 6859 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:33:32.849181 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 6730
I20260808 08:33:32.867259 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 6347
I20260808 08:33:32.868434 6414 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:33:32.976122 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 6347
2026-08-08T08:33:32Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4272 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:33:33 dist-test-slave-chsk krb5kdc[6919](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:33:33 dist-test-slave-chsk krb5kdc[6919](info): set up 2 sockets
Aug 08 08:33:33 dist-test-slave-chsk krb5kdc[6919](info): commencing operation
krb5kdc: starting...
W20260808 08:33:34.103716 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.000s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:33:34 dist-test-slave-chsk krb5kdc[6919](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:33:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:33:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:33:34.306159 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:38791
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:33235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:38791
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:34.626251 6933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:34.626624 6933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:34.626804 6933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:34.634259 6933 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:34.634429 6933 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 08:33:34.634534 6933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:34.634662 6933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:34.634752 6933 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:34.634843 6933 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:34.645044 6933 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:33235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:38791
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:38791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:34.646466 6933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:34.647866 6933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:34.660044 6938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:34.660095 6939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:34.660148 6941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:34.660957 6933 server_base.cc:1034] running on GCE node
I20260808 08:33:34.661823 6933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:34.663394 6933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:34.664651 6933 hybrid_clock.cc:648] HybridClock initialized: now 1786178014664589 us; error 40 us; skew 500 ppm
I20260808 08:33:34.665006 6933 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:34 dist-test-slave-chsk krb5kdc[6919](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178014, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:34.668195 6933 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:33:34.669730 6933 webserver.cc:460] Webserver started at http://127.5.164.254:37671/ using document root <none> and password file <none>
I20260808 08:33:34.670431 6933 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:34.670560 6933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:34.670900 6933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:34.674077 6933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "a509317edadc4939b185cb2248a01a98"
format_stamp: "Formatted at 2026-08-08 08:33:34 on dist-test-slave-chsk"
server_key: "469b76998ce5d725dab0b5f075327c80"
server_key_iv: "3b3691aeaeae61245e3b4e467ee4211f"
server_key_version: "encryptionkey@0"
I20260808 08:33:34.674894 6933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "a509317edadc4939b185cb2248a01a98"
format_stamp: "Formatted at 2026-08-08 08:33:34 on dist-test-slave-chsk"
server_key: "469b76998ce5d725dab0b5f075327c80"
server_key_iv: "3b3691aeaeae61245e3b4e467ee4211f"
server_key_version: "encryptionkey@0"
I20260808 08:33:34.680424 6933 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 08:33:34.684154 6948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:34.685535 6933 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:33:34.685726 6933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "a509317edadc4939b185cb2248a01a98"
format_stamp: "Formatted at 2026-08-08 08:33:34 on dist-test-slave-chsk"
server_key: "469b76998ce5d725dab0b5f075327c80"
server_key_iv: "3b3691aeaeae61245e3b4e467ee4211f"
server_key_version: "encryptionkey@0"
I20260808 08:33:34.685951 6933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:34.699048 6933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:34.703990 6933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:34.704319 6933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:34.728096 6933 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:38791
I20260808 08:33:34.728176 7013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:38791 every 8 connection(s)
I20260808 08:33:34.729655 6933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:34.733593 7014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:34.734634 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 6933
I20260808 08:33:34.734881 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:33:34.735616 5779 external_mini_cluster.cc:1428] Setting key 6cb15cb3a6cffd0ff09a9fda5f1856aa
I20260808 08:33:34.749522 7014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98: Bootstrap starting.
Aug 08 08:33:34 dist-test-slave-chsk krb5kdc[6919](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:34.753008 7014 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:34.754480 7014 log.cc:824] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:34.757731 7014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98: No bootstrap required, opened a new log
I20260808 08:33:34.761869 7017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:34.737762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56910 (local address 127.5.164.254:38791)
0808 08:33:34.738942 (+ 1180us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:34.738959 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:34.739020 (+ 61us) server_negotiation.cc:407] Connection header received
0808 08:33:34.741683 (+ 2663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:34.741714 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:34.742280 (+ 566us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:34.742767 (+ 487us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:34.744223 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:34.746296 (+ 2073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:34.747766 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:34.748799 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:34.748986 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:34.753666 (+ 4680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:34.753677 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:34.753696 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:34.753747 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:34.757321 (+ 3574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:34.758234 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:34.758240 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:34.758250 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:34.758429 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:34.758897 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:34.758901 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:34.758903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:34.759669 (+ 766us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:34.759900 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:34.760385 (+ 485us) server_negotiation.cc:299] Negotiation successful
0808 08:33:34.760794 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":851,"thread_start_us":537,"threads_started":1}
I20260808 08:33:34.766785 7014 raft_consensus.cc:348] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a509317edadc4939b185cb2248a01a98" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38791 } }
I20260808 08:33:34.767208 7014 raft_consensus.cc:374] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:34.767330 7014 raft_consensus.cc:729] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a509317edadc4939b185cb2248a01a98, State: Initialized, Role: FOLLOWER
I20260808 08:33:34.767985 7014 consensus_queue.cc:260] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a509317edadc4939b185cb2248a01a98" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38791 } }
I20260808 08:33:34.768280 7014 raft_consensus.cc:388] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:34.768443 7014 raft_consensus.cc:482] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:34.768620 7014 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:34.770853 7014 raft_consensus.cc:504] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a509317edadc4939b185cb2248a01a98" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38791 } }
I20260808 08:33:34.771413 7014 leader_election.cc:302] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a509317edadc4939b185cb2248a01a98; no voters:
I20260808 08:33:34.772019 7014 leader_election.cc:288] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:33:34.772195 7019 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:34.773651 7019 raft_consensus.cc:686] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [term 1 LEADER]: Becoming Leader. State: Replica: a509317edadc4939b185cb2248a01a98, State: Running, Role: LEADER
I20260808 08:33:34.774263 7014 sys_catalog.cc:564] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:34.774227 7019 consensus_queue.cc:237] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a509317edadc4939b185cb2248a01a98" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38791 } }
I20260808 08:33:34.777316 7021 sys_catalog.cc:455] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a509317edadc4939b185cb2248a01a98. Latest consensus state: current_term: 1 leader_uuid: "a509317edadc4939b185cb2248a01a98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a509317edadc4939b185cb2248a01a98" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38791 } } }
I20260808 08:33:34.777643 7020 sys_catalog.cc:455] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a509317edadc4939b185cb2248a01a98" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a509317edadc4939b185cb2248a01a98" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38791 } } }
I20260808 08:33:34.777882 7021 sys_catalog.cc:458] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:34.777941 7020 sys_catalog.cc:458] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:34.780737 7028 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:34.784920 7028 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:34.793530 7028 catalog_manager.cc:1347] Generated new cluster ID: f328e2a454d841acb997431f150e9528
I20260808 08:33:34.793658 7028 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:34.804806 7028 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:33:34.806708 7028 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:34.816849 7028 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98: Generated new TSK 0
I20260808 08:33:34.817981 7028 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:33:34.879453 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:38791
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:33235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:35.220961 7042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:35.221311 7042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:35.221472 7042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:35.229001 7042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:35.229185 7042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:35.229333 7042 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:33:35.229472 7042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:33:35.239990 7042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:33235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.164.254:38791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:35.241487 7042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:35.242908 7042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:35.256718 7047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:35.256752 7048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:35.256947 7050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:35.257676 7042 server_base.cc:1034] running on GCE node
I20260808 08:33:35.258368 7042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:35.259358 7042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:35.260596 7042 hybrid_clock.cc:648] HybridClock initialized: now 1786178015260528 us; error 34 us; skew 500 ppm
I20260808 08:33:35.260913 7042 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:35 dist-test-slave-chsk krb5kdc[6919](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178015, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:35.264370 7042 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:33:35.265916 7042 webserver.cc:460] Webserver started at http://127.5.164.193:33379/ using document root <none> and password file <none>
I20260808 08:33:35.266642 7042 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:35.266780 7042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:35.267122 7042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:35.270076 7042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "10e289cc231c41ceb38fbe79c83c3b05"
format_stamp: "Formatted at 2026-08-08 08:33:35 on dist-test-slave-chsk"
server_key: "c4f736240676a53b3946eb78075282d5"
server_key_iv: "2071e419f59ba87c42f3c71a94d1ade6"
server_key_version: "encryptionkey@0"
I20260808 08:33:35.270895 7042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "10e289cc231c41ceb38fbe79c83c3b05"
format_stamp: "Formatted at 2026-08-08 08:33:35 on dist-test-slave-chsk"
server_key: "c4f736240676a53b3946eb78075282d5"
server_key_iv: "2071e419f59ba87c42f3c71a94d1ade6"
server_key_version: "encryptionkey@0"
I20260808 08:33:35.276451 7042 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260808 08:33:35.280402 7057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:35.281735 7042 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:33:35.281924 7042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "10e289cc231c41ceb38fbe79c83c3b05"
format_stamp: "Formatted at 2026-08-08 08:33:35 on dist-test-slave-chsk"
server_key: "c4f736240676a53b3946eb78075282d5"
server_key_iv: "2071e419f59ba87c42f3c71a94d1ade6"
server_key_version: "encryptionkey@0"
I20260808 08:33:35.282181 7042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:35.293519 7042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:35.298233 7042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:35.298537 7042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:35.301541 7042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:35.301667 7042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:35.301887 7042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:35.302062 7042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:33:35 dist-test-slave-chsk krb5kdc[6919](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178015, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:35.328900 7067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:35.302221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:46415 (local address 127.5.164.254:38791)
0808 08:33:35.303101 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:35.303108 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:35.304321 (+ 1213us) server_negotiation.cc:407] Connection header received
0808 08:33:35.306490 (+ 2169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:35.306500 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:35.306622 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:35.306757 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:35.309256 (+ 2499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:35.310348 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:35.313348 (+ 3000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:35.313867 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:35.314029 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:35.320449 (+ 6420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:35.320455 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:35.320458 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:35.320504 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:35.323624 (+ 3120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:35.325049 (+ 1425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:35.325061 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:35.325063 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:35.325205 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:35.326086 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:35.326092 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:35.326097 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:35.326538 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:35.326717 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:35.328065 (+ 1348us) server_negotiation.cc:299] Negotiation successful
0808 08:33:35.328397 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":747,"thread_start_us":628,"threads_started":1}
I20260808 08:33:35.332456 7068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:35.303074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38791 (local address 127.5.164.193:46415)
0808 08:33:35.304098 (+ 1024us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:35.304158 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:35.306157 (+ 1999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:35.307043 (+ 886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:35.307052 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:35.307976 (+ 924us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:35.309010 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:35.309052 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:35.310522 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:35.310529 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:35.313173 (+ 2644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:35.313192 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:35.314227 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:35.314244 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:35.314649 (+ 405us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:35.316019 (+ 1370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:35.316068 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:35.320154 (+ 4086us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:35.323857 (+ 3703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:35.323872 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:35.323892 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:35.324848 (+ 956us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:35.325342 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:35.325351 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:35.325358 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:35.325803 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:35.326732 (+ 929us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:35.326746 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:35.327458 (+ 712us) client_negotiation.cc:769] Sending connection context
0808 08:33:35.329301 (+ 1843us) client_negotiation.cc:240] Negotiation successful
0808 08:33:35.330240 (+ 939us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"thread_start_us":413,"threads_started":1}
I20260808 08:33:35.350492 7184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:42447 every 8 connection(s)
I20260808 08:33:35.350492 7042 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:42447
I20260808 08:33:35.352356 7042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:33:35.353220 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 7042
I20260808 08:33:35.353464 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:33:35.354385 5779 external_mini_cluster.cc:1428] Setting key eedd1c0e2c5c8f11136cc1522d78a8ff
I20260808 08:33:35.357570 7185 heartbeater.cc:347] Connected to a master server at 127.5.164.254:38791
I20260808 08:33:35.359552 7185 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:35.360421 7185 heartbeater.cc:511] Master 127.5.164.254:38791 requested a full tablet report, sending...
I20260808 08:33:35.361343 7067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:35.341505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:39699 (local address 127.5.164.254:38791)
0808 08:33:35.341713 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:35.341721 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:35.342462 (+ 741us) server_negotiation.cc:407] Connection header received
0808 08:33:35.342807 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:35.342813 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:35.342904 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:35.342966 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:35.344482 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:35.345743 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:35.348609 (+ 2866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:35.349061 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:35.349220 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:35.351979 (+ 2759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:35.351985 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:35.351988 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:35.352024 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:35.355715 (+ 3691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:35.356733 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:35.356738 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:35.356741 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:35.356913 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:35.359481 (+ 2568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:35.359488 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:35.359495 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:35.359908 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:35.360090 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:35.360704 (+ 614us) server_negotiation.cc:299] Negotiation successful
0808 08:33:35.360985 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 08:33:35.361652 7164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:35.341568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38791 (local address 127.5.164.193:39699)
0808 08:33:35.342319 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:35.342352 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:35.342609 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:35.343216 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:35.343222 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:35.344014 (+ 792us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:35.344321 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:35.344330 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:35.345940 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:35.345954 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:35.348431 (+ 2477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:35.348450 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:35.349323 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:35.349333 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:35.349591 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:35.350511 (+ 920us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:35.350539 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:35.351746 (+ 1207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:35.355904 (+ 4158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:35.355910 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:35.355913 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:35.356577 (+ 664us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:35.357043 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:35.357052 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:35.357056 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:35.357218 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:35.360066 (+ 2848us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:35.360074 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:35.360337 (+ 263us) client_negotiation.cc:769] Sending connection context
0808 08:33:35.360521 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 08:33:35.360946 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":428,"threads_started":1}
I20260808 08:33:35.363099 6966 ts_manager.cc:194] Registered new tserver with Master: 10e289cc231c41ceb38fbe79c83c3b05 (127.5.164.193:42447)
I20260808 08:33:35.365128 6966 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:46415
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:33:35.402823 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:38791
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:33235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:35.745772 7189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:35.746152 7189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:35.746305 7189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:35.756383 7189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:35.756515 7189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:35.756603 7189 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:33:35.756687 7189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:33:35.766721 7189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:33235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.164.254:38791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:35.768121 7189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:35.769444 7189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:35.783607 7194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:35.783579 7197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:35.783648 7195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:35.784886 7189 server_base.cc:1034] running on GCE node
I20260808 08:33:35.785593 7189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:35.786689 7189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:35.787927 7189 hybrid_clock.cc:648] HybridClock initialized: now 1786178015787859 us; error 46 us; skew 500 ppm
I20260808 08:33:35.788245 7189 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:35 dist-test-slave-chsk krb5kdc[6919](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178015, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:35.791721 7189 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:33:35.793355 7189 webserver.cc:460] Webserver started at http://127.5.164.194:40123/ using document root <none> and password file <none>
I20260808 08:33:35.794082 7189 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:35.794230 7189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:35.794569 7189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:35.797720 7189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "fdc54ace73de42d286acb4f44c92f0bc"
format_stamp: "Formatted at 2026-08-08 08:33:35 on dist-test-slave-chsk"
server_key: "6379c8cbb59d05133f39c5c37ee9d582"
server_key_iv: "5d339d3beab093de640f031f4817f1b9"
server_key_version: "encryptionkey@0"
I20260808 08:33:35.798584 7189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "fdc54ace73de42d286acb4f44c92f0bc"
format_stamp: "Formatted at 2026-08-08 08:33:35 on dist-test-slave-chsk"
server_key: "6379c8cbb59d05133f39c5c37ee9d582"
server_key_iv: "5d339d3beab093de640f031f4817f1b9"
server_key_version: "encryptionkey@0"
I20260808 08:33:35.804023 7189 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260808 08:33:35.807564 7205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:35.808866 7189 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:33:35.809052 7189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "fdc54ace73de42d286acb4f44c92f0bc"
format_stamp: "Formatted at 2026-08-08 08:33:35 on dist-test-slave-chsk"
server_key: "6379c8cbb59d05133f39c5c37ee9d582"
server_key_iv: "5d339d3beab093de640f031f4817f1b9"
server_key_version: "encryptionkey@0"
I20260808 08:33:35.809297 7189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:35.828644 7189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:35.833374 7189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:35.833760 7189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:35.837026 7189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:35.837139 7189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:35.837275 7189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:35.837357 7189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:33:35 dist-test-slave-chsk krb5kdc[6919](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178015, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:35.863405 7067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:35.837656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:54679 (local address 127.5.164.254:38791)
0808 08:33:35.837903 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:35.837911 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:35.839590 (+ 1679us) server_negotiation.cc:407] Connection header received
0808 08:33:35.841723 (+ 2133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:35.841731 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:35.841870 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:35.842014 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:35.845129 (+ 3115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:35.846182 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:35.849633 (+ 3451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:35.850275 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:35.850450 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:35.855961 (+ 5511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:35.855966 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:35.855969 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:35.856006 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:35.858938 (+ 2932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:35.860013 (+ 1075us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:35.860019 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:35.860022 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:35.860214 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:35.860846 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:35.860852 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:35.860856 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:35.861261 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:35.861448 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:35.862792 (+ 1344us) server_negotiation.cc:299] Negotiation successful
0808 08:33:35.862990 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 08:33:35.865615 7214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:35.838362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38791 (local address 127.5.164.194:54679)
0808 08:33:35.839375 (+ 1013us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:35.839421 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:35.841370 (+ 1949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:35.842352 (+ 982us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:35.842370 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:35.843571 (+ 1201us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:35.844758 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:35.844795 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:35.846413 (+ 1618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:35.846422 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:35.849381 (+ 2959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:35.849413 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:35.850665 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:35.850673 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:35.851057 (+ 384us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:35.852211 (+ 1154us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:35.852257 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:35.855660 (+ 3403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:35.859123 (+ 3463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:35.859133 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:35.859195 (+ 62us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:35.859820 (+ 625us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:35.860380 (+ 560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:35.860387 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:35.860393 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:35.860709 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:35.861433 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:35.861446 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:35.862226 (+ 780us) client_negotiation.cc:769] Sending connection context
0808 08:33:35.862661 (+ 435us) client_negotiation.cc:240] Negotiation successful
0808 08:33:35.863564 (+ 903us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"thread_start_us":395,"threads_started":1}
I20260808 08:33:35.895869 7067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:35.871891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:34355 (local address 127.5.164.254:38791)
0808 08:33:35.872092 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:35.872101 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:35.879172 (+ 7071us) server_negotiation.cc:407] Connection header received
0808 08:33:35.879444 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:35.879451 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:35.879544 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:35.879685 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:35.880754 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:35.881937 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:35.883396 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:35.884031 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:35.884206 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:35.887505 (+ 3299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:35.887515 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:35.887523 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:35.887577 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:35.892285 (+ 4708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:35.893068 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:35.893077 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:35.893083 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:35.893308 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:35.893731 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:35.893739 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:35.893745 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:35.894359 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:35.894550 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:35.895118 (+ 568us) server_negotiation.cc:299] Negotiation successful
0808 08:33:35.895431 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:33:35.895963 7270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:35.871913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38791 (local address 127.5.164.194:34355)
0808 08:33:35.878962 (+ 7049us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:35.878995 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:35.879272 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:35.879722 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:35.879727 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:35.880285 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:35.880585 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:35.880595 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:35.882111 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:35.882117 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:35.883248 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:35.883261 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:35.884311 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:35.884320 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:35.884724 (+ 404us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:35.885674 (+ 950us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:35.885700 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:35.887251 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:35.892466 (+ 5215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:35.892471 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:35.892474 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:35.892918 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:35.893456 (+ 538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:35.893460 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:35.893462 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:35.893606 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:35.894501 (+ 895us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:35.894504 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:35.894775 (+ 271us) client_negotiation.cc:769] Sending connection context
0808 08:33:35.894925 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 08:33:35.895282 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6795,"thread_start_us":6546,"threads_started":1}
I20260808 08:33:35.899753 7189 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:46289
I20260808 08:33:35.899778 7331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:46289 every 8 connection(s)
I20260808 08:33:35.901373 7189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:33:35.903379 7332 heartbeater.cc:347] Connected to a master server at 127.5.164.254:38791
I20260808 08:33:35.903620 7332 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:35.904251 7332 heartbeater.cc:511] Master 127.5.164.254:38791 requested a full tablet report, sending...
I20260808 08:33:35.905256 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 7189
I20260808 08:33:35.905470 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:33:35.905747 6966 ts_manager.cc:194] Registered new tserver with Master: fdc54ace73de42d286acb4f44c92f0bc (127.5.164.194:46289)
I20260808 08:33:35.906045 5779 external_mini_cluster.cc:1428] Setting key 4953e2e19fb72f391513efe954c3ffa8
I20260808 08:33:35.906824 6966 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:54679
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:33:35.954053 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:38791
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:33235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:36.288251 7336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:36.288555 7336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:36.288655 7336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:36.296017 7336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:36.296136 7336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:36.296224 7336 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:33:36.296309 7336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:33:36.306249 7336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:33235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.164.254:38791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:36.307577 7336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:36.308858 7336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:36.322751 7341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:36.322793 7344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:36.322826 7342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:36.323770 7336 server_base.cc:1034] running on GCE node
I20260808 08:33:36.324318 7336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:36.325208 7336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:36.326426 7336 hybrid_clock.cc:648] HybridClock initialized: now 1786178016326366 us; error 31 us; skew 500 ppm
I20260808 08:33:36.326694 7336 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:36 dist-test-slave-chsk krb5kdc[6919](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178016, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:36.329887 7336 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:33:36.331426 7336 webserver.cc:460] Webserver started at http://127.5.164.195:37743/ using document root <none> and password file <none>
I20260808 08:33:36.332106 7336 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:36.332197 7336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:36.332475 7336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:36.335525 7336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "9464caa7ce664f69afefb83fcac4fdd1"
format_stamp: "Formatted at 2026-08-08 08:33:36 on dist-test-slave-chsk"
server_key: "40d0905927cddb24b51f81d874e271bd"
server_key_iv: "764b0189d0f31324795e02e194d64000"
server_key_version: "encryptionkey@0"
I20260808 08:33:36.336429 7336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "9464caa7ce664f69afefb83fcac4fdd1"
format_stamp: "Formatted at 2026-08-08 08:33:36 on dist-test-slave-chsk"
server_key: "40d0905927cddb24b51f81d874e271bd"
server_key_iv: "764b0189d0f31324795e02e194d64000"
server_key_version: "encryptionkey@0"
I20260808 08:33:36.341573 7336 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:33:36.345049 7351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:36.346423 7336 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:33:36.346624 7336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "9464caa7ce664f69afefb83fcac4fdd1"
format_stamp: "Formatted at 2026-08-08 08:33:36 on dist-test-slave-chsk"
server_key: "40d0905927cddb24b51f81d874e271bd"
server_key_iv: "764b0189d0f31324795e02e194d64000"
server_key_version: "encryptionkey@0"
I20260808 08:33:36.346817 7336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:36.365741 7336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:36.368168 7185 heartbeater.cc:503] Master 127.5.164.254:38791 was elected leader, sending a full tablet report...
I20260808 08:33:36.370704 7336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:36.370997 7336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:36.373843 7336 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:36.373950 7336 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:36.374109 7336 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:36.374258 7336 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 08 08:33:36 dist-test-slave-chsk krb5kdc[6919](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178016, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:36.397578 7067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.374326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:48897 (local address 127.5.164.254:38791)
0808 08:33:36.374502 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:36.374507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:36.376130 (+ 1623us) server_negotiation.cc:407] Connection header received
0808 08:33:36.378528 (+ 2398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:36.378534 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:36.378645 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:36.378787 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:36.381111 (+ 2324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.382010 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.383973 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.384574 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.384652 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:36.390355 (+ 5703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:36.390362 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:36.390366 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:36.390409 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:36.393989 (+ 3580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:36.394753 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:36.394759 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:36.394762 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:36.394899 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:36.395433 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:36.395438 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:36.395441 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:36.395853 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:36.396029 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:36.396969 (+ 940us) server_negotiation.cc:299] Negotiation successful
0808 08:33:36.397223 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:33:36.398609 7361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.375059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38791 (local address 127.5.164.195:48897)
0808 08:33:36.375939 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:36.375977 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:36.378126 (+ 2149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:36.379048 (+ 922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:36.379059 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:36.379915 (+ 856us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:36.380921 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:36.380944 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.382225 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.382235 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:36.383763 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:36.383784 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.385098 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.385110 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:36.385397 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:36.386336 (+ 939us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:36.386375 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:36.390106 (+ 3731us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:36.394164 (+ 4058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:36.394173 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:36.394190 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:36.394617 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:36.395015 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:36.395019 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:36.395023 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:36.395305 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:36.396001 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:36.396009 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:36.396565 (+ 556us) client_negotiation.cc:769] Sending connection context
0808 08:33:36.396855 (+ 290us) client_negotiation.cc:240] Negotiation successful
0808 08:33:36.397377 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":379,"threads_started":1}
I20260808 08:33:36.423131 7067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.406792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:36627 (local address 127.5.164.254:38791)
0808 08:33:36.407011 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:36.407029 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:36.407814 (+ 785us) server_negotiation.cc:407] Connection header received
0808 08:33:36.408016 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:36.408019 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:36.408096 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:36.408177 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:36.409649 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.410333 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.413048 (+ 2715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.413629 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.413736 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:36.416867 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:36.416876 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:36.416882 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:36.416924 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:36.420102 (+ 3178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:36.421102 (+ 1000us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:36.421107 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:36.421109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:36.421251 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:36.421638 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:36.421642 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:36.421646 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:36.421907 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:36.422090 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:36.422490 (+ 400us) server_negotiation.cc:299] Negotiation successful
0808 08:33:36.422718 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 08:33:36.423247 7421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.406804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38791 (local address 127.5.164.195:36627)
0808 08:33:36.407683 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:36.407709 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:36.407888 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:36.408246 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:36.408253 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:36.409005 (+ 752us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:36.409475 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:36.409499 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.410481 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.410489 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:36.412879 (+ 2390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:36.412898 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.413966 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.413976 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:36.414252 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:36.415177 (+ 925us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:36.415207 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:36.416661 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:36.420286 (+ 3625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:36.420291 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:36.420295 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:36.420962 (+ 667us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:36.421368 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:36.421373 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:36.421377 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:36.421513 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:36.422047 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:36.422052 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:36.422235 (+ 183us) client_negotiation.cc:769] Sending connection context
0808 08:33:36.422375 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 08:33:36.422718 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":502,"threads_started":1}
I20260808 08:33:36.432662 7336 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:33055
I20260808 08:33:36.432682 7476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:33055 every 8 connection(s)
I20260808 08:33:36.433878 7336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:33:36.435602 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 7336
I20260808 08:33:36.435810 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:33:36.436205 7477 heartbeater.cc:347] Connected to a master server at 127.5.164.254:38791
I20260808 08:33:36.436399 5779 external_mini_cluster.cc:1428] Setting key 6afaba730de7f10e9f35abf25ec85b97
I20260808 08:33:36.436445 7477 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:36.437249 7477 heartbeater.cc:511] Master 127.5.164.254:38791 requested a full tablet report, sending...
I20260808 08:33:36.438696 6965 ts_manager.cc:194] Registered new tserver with Master: 9464caa7ce664f69afefb83fcac4fdd1 (127.5.164.195:33055)
I20260808 08:33:36.439730 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:33:36.439867 6965 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:48897
Aug 08 08:33:36 dist-test-slave-chsk krb5kdc[6919](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178016, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:33:36 dist-test-slave-chsk krb5kdc[6919](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178016, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:36.491881 7067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.476881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56916 (local address 127.5.164.254:38791)
0808 08:33:36.477146 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:36.477155 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:36.477670 (+ 515us) server_negotiation.cc:407] Connection header received
0808 08:33:36.477899 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:36.477904 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:36.478008 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:36.478129 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:36.479707 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.480470 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.481777 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.482351 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.482491 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:36.486532 (+ 4041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:36.486538 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:36.486541 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:36.486618 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:36.489240 (+ 2622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:36.489924 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:36.489928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:36.489930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:36.490073 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:36.490442 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:36.490446 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:36.490448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:36.490735 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:36.491003 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:36.491320 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 08:33:36.491487 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 08:33:36.496095 6965 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56916:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:33:36.503472 6965 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:33:36.537998 7493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.515293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43496 (local address 127.5.164.193:42447)
0808 08:33:36.528843 (+ 13550us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:36.528854 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:36.528888 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:33:36.528997 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:36.529005 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:36.529282 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:36.530242 (+ 960us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:36.530481 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.532221 (+ 1740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.535086 (+ 2865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.536728 (+ 1642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.537234 (+ 506us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:36.537454 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:36.537536 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 08:33:36.537698 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13378,"thread_start_us":13242,"threads_started":1}
I20260808 08:33:36.538250 7491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.515043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42447 (local address 127.0.0.1:43496)
0808 08:33:36.527859 (+ 12816us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:36.527924 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:36.528165 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:36.529535 (+ 1370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:36.529542 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:36.529573 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:36.530034 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:36.530048 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.532378 (+ 2330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.532383 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:36.534849 (+ 2466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:36.534871 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.536986 (+ 2115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.536995 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:36.537291 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:36.537325 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:33:36.537426 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 08:33:36.537694 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12444,"mutex_wait_us":59,"thread_start_us":12347,"threads_started":1}
I20260808 08:33:36.538197 7492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.515266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:33055 (local address 127.0.0.1:58098)
0808 08:33:36.529153 (+ 13887us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:36.529171 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:36.529296 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:36.530317 (+ 1021us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:36.530321 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:36.530345 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:36.530791 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:36.530803 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.532869 (+ 2066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.532874 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:36.535060 (+ 2186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:36.535072 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.537007 (+ 1935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.537013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:36.537231 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:36.537307 (+ 76us) client_negotiation.cc:769] Sending connection context
0808 08:33:36.537428 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 08:33:36.537676 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13771,"mutex_wait_us":96,"thread_start_us":13624,"threads_started":1}
I20260808 08:33:36.539186 7494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.515675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58098 (local address 127.5.164.195:33055)
0808 08:33:36.527344 (+ 11669us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:36.527356 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:36.529426 (+ 2070us) server_negotiation.cc:407] Connection header received
0808 08:33:36.529537 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:36.529544 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:36.529743 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:36.529943 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:36.531045 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.532722 (+ 1677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.535277 (+ 2555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.536727 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.538367 (+ 1640us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:36.538622 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:36.538696 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 08:33:36.538874 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11404,"thread_start_us":11189,"threads_started":1}
I20260808 08:33:36.542133 7110 tablet_service.cc:1467] Processing CreateTablet for tablet add1b8ca52d14a32a0e57f242d99ff9b (DEFAULT_TABLE table=test-table [id=992365e60df2437dba4fa864e7255cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:36.542698 7403 tablet_service.cc:1467] Processing CreateTablet for tablet add1b8ca52d14a32a0e57f242d99ff9b (DEFAULT_TABLE table=test-table [id=992365e60df2437dba4fa864e7255cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:36.543519 7110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet add1b8ca52d14a32a0e57f242d99ff9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:36.544094 7403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet add1b8ca52d14a32a0e57f242d99ff9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:36.545980 7495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.529566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:46289 (local address 127.0.0.1:33498)
0808 08:33:36.536807 (+ 7241us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:36.536826 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:36.536955 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:36.537866 (+ 911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:36.537873 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:36.537899 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:36.538608 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:36.538621 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.540869 (+ 2248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.540878 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:36.542966 (+ 2088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:36.542981 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.545166 (+ 2185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.545173 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:36.545370 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:36.545406 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:33:36.545508 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 08:33:36.545645 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6481,"thread_start_us":6647,"threads_started":1}
I20260808 08:33:36.546068 7496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.529592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33498 (local address 127.5.164.194:46289)
0808 08:33:36.536718 (+ 7126us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:36.536727 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:36.537091 (+ 364us) server_negotiation.cc:407] Connection header received
0808 08:33:36.537244 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:36.537250 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:36.537472 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:36.537666 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:36.538798 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.540714 (+ 1916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.543162 (+ 2448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.544694 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.544832 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:36.545024 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:36.545591 (+ 567us) server_negotiation.cc:299] Negotiation successful
0808 08:33:36.545774 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6957,"thread_start_us":6963,"threads_started":1}
I20260808 08:33:36.549742 7256 tablet_service.cc:1467] Processing CreateTablet for tablet add1b8ca52d14a32a0e57f242d99ff9b (DEFAULT_TABLE table=test-table [id=992365e60df2437dba4fa864e7255cb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:36.551120 7256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet add1b8ca52d14a32a0e57f242d99ff9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:36.556733 7497 tablet_bootstrap.cc:492] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05: Bootstrap starting.
I20260808 08:33:36.559883 7498 tablet_bootstrap.cc:492] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1: Bootstrap starting.
I20260808 08:33:36.560094 7497 tablet_bootstrap.cc:654] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:36.561440 7497 log.cc:824] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:36.563632 7498 tablet_bootstrap.cc:654] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:36.564828 7498 log.cc:824] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:36.565209 7497 tablet_bootstrap.cc:492] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05: No bootstrap required, opened a new log
I20260808 08:33:36.565230 7500 tablet_bootstrap.cc:492] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc: Bootstrap starting.
I20260808 08:33:36.565555 7497 ts_tablet_manager.cc:1397] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 08:33:36.568208 7500 tablet_bootstrap.cc:654] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:36.569193 7500 log.cc:824] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:36.569901 7498 tablet_bootstrap.cc:492] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1: No bootstrap required, opened a new log
I20260808 08:33:36.570182 7498 ts_tablet_manager.cc:1397] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.002s
I20260808 08:33:36.572057 7500 tablet_bootstrap.cc:492] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc: No bootstrap required, opened a new log
I20260808 08:33:36.572319 7500 ts_tablet_manager.cc:1397] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 08:33:36.576472 7497 raft_consensus.cc:348] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } }
I20260808 08:33:36.576920 7497 raft_consensus.cc:374] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:36.577073 7497 raft_consensus.cc:729] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10e289cc231c41ceb38fbe79c83c3b05, State: Initialized, Role: FOLLOWER
I20260808 08:33:36.577788 7497 consensus_queue.cc:260] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } }
I20260808 08:33:36.581002 7497 ts_tablet_manager.cc:1428] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260808 08:33:36.580826 7498 raft_consensus.cc:348] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } }
I20260808 08:33:36.580928 7500 raft_consensus.cc:348] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } }
I20260808 08:33:36.581341 7498 raft_consensus.cc:374] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:36.581382 7500 raft_consensus.cc:374] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:36.581477 7498 raft_consensus.cc:729] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9464caa7ce664f69afefb83fcac4fdd1, State: Initialized, Role: FOLLOWER
I20260808 08:33:36.581485 7500 raft_consensus.cc:729] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc54ace73de42d286acb4f44c92f0bc, State: Initialized, Role: FOLLOWER
I20260808 08:33:36.582052 7498 consensus_queue.cc:260] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } }
I20260808 08:33:36.582177 7500 consensus_queue.cc:260] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } }
I20260808 08:33:36.583408 7332 heartbeater.cc:503] Master 127.5.164.254:38791 was elected leader, sending a full tablet report...
I20260808 08:33:36.585556 7500 ts_tablet_manager.cc:1428] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260808 08:33:36.587352 7477 heartbeater.cc:503] Master 127.5.164.254:38791 was elected leader, sending a full tablet report...
I20260808 08:33:36.587423 7498 ts_tablet_manager.cc:1428] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1: Time spent starting tablet: real 0.017s user 0.013s sys 0.006s
W20260808 08:33:36.608001 7186 tablet.cc:2369] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:33:36.653534 7333 tablet.cc:2369] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:33:36.687595 7478 tablet.cc:2369] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:33:36.991537 7506 raft_consensus.cc:482] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:36.992002 7506 raft_consensus.cc:504] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } }
I20260808 08:33:36.994172 7506 leader_election.cc:288] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10e289cc231c41ceb38fbe79c83c3b05 (127.5.164.193:42447), 9464caa7ce664f69afefb83fcac4fdd1 (127.5.164.195:33055)
I20260808 08:33:36.999116 7504 raft_consensus.cc:482] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:36.999557 7504 raft_consensus.cc:504] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } }
I20260808 08:33:37.004386 7494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.994748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:53741 (local address 127.5.164.195:33055)
0808 08:33:36.995004 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:36.995011 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:36.995483 (+ 472us) server_negotiation.cc:407] Connection header received
0808 08:33:36.995711 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:36.995715 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:36.995772 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:36.995868 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:36.996492 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.997389 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.001089 (+ 3700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.002530 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.002693 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.002772 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:37.003956 (+ 1184us) server_negotiation.cc:299] Negotiation successful
0808 08:33:37.004120 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107}
I20260808 08:33:37.004503 7493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.994507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:59833 (local address 127.5.164.193:42447)
0808 08:33:36.994747 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:36.994756 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:36.995524 (+ 768us) server_negotiation.cc:407] Connection header received
0808 08:33:36.995796 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:36.995800 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:36.995862 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:36.995962 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:36.996653 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.997362 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.001342 (+ 3980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.002903 (+ 1561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.003038 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.003160 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:37.004063 (+ 903us) server_negotiation.cc:299] Negotiation successful
0808 08:33:37.004211 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 08:33:37.005481 7507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.994534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:33055 (local address 127.5.164.194:53741)
0808 08:33:36.995370 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:36.995390 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:36.995563 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:36.995883 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:36.995887 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:36.995909 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:36.996345 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:36.996354 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.997553 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.997558 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.000906 (+ 3348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:37.000927 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.003267 (+ 2340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.003278 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.003751 (+ 473us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.003788 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:33:37.004595 (+ 807us) client_negotiation.cc:240] Negotiation successful
0808 08:33:37.004757 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"mutex_wait_us":92,"thread_start_us":400,"threads_started":1}
I20260808 08:33:37.005734 7508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:36.994559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42447 (local address 127.5.164.194:59833)
0808 08:33:36.995408 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:36.995424 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:36.995629 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:36.995980 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:36.995984 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:36.996021 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:36.996493 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:36.996502 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:36.997490 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:36.997498 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.001140 (+ 3642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:37.001153 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.003704 (+ 2551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.003712 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.003872 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.003916 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 08:33:37.004727 (+ 811us) client_negotiation.cc:240] Negotiation successful
0808 08:33:37.005172 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"mutex_wait_us":71,"spinlock_wait_cycles":48768,"thread_start_us":509,"threads_started":1}
I20260808 08:33:37.006762 7429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add1b8ca52d14a32a0e57f242d99ff9b" candidate_uuid: "fdc54ace73de42d286acb4f44c92f0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9464caa7ce664f69afefb83fcac4fdd1" is_pre_election: true
I20260808 08:33:37.007460 7429 raft_consensus.cc:2454] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdc54ace73de42d286acb4f44c92f0bc in term 0.
I20260808 08:33:37.008324 7208 leader_election.cc:302] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9464caa7ce664f69afefb83fcac4fdd1, fdc54ace73de42d286acb4f44c92f0bc; no voters:
I20260808 08:33:37.008491 7131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add1b8ca52d14a32a0e57f242d99ff9b" candidate_uuid: "fdc54ace73de42d286acb4f44c92f0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10e289cc231c41ceb38fbe79c83c3b05" is_pre_election: true
I20260808 08:33:37.009055 7506 raft_consensus.cc:2781] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:37.009334 7506 raft_consensus.cc:482] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:37.009542 7506 raft_consensus.cc:3037] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:37.009325 7131 raft_consensus.cc:2454] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdc54ace73de42d286acb4f44c92f0bc in term 0.
I20260808 08:33:37.009760 7504 leader_election.cc:288] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9464caa7ce664f69afefb83fcac4fdd1 (127.5.164.195:33055), fdc54ace73de42d286acb4f44c92f0bc (127.5.164.194:46289)
I20260808 08:33:37.024487 7494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.004836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:41571 (local address 127.5.164.195:33055)
0808 08:33:37.005004 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:37.005009 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:37.014843 (+ 9834us) server_negotiation.cc:407] Connection header received
0808 08:33:37.015248 (+ 405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:37.015253 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:37.015323 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:37.015426 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:37.016283 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.017245 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.021865 (+ 4620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.022994 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.023215 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.023276 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:37.023886 (+ 610us) server_negotiation.cc:299] Negotiation successful
0808 08:33:37.024019 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:33:37.024760 7510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.004003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:33055 (local address 127.5.164.193:41571)
0808 08:33:37.014660 (+ 10657us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:37.014702 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:37.014995 (+ 293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:37.015445 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:37.015450 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:37.015476 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:37.016103 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:37.016119 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.017397 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.017401 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.021630 (+ 4229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:37.021647 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.023521 (+ 1874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.023526 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.023682 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.023706 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:33:37.023850 (+ 144us) client_negotiation.cc:240] Negotiation successful
0808 08:33:37.023997 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10416,"mutex_wait_us":22,"thread_start_us":11217,"threads_started":1}
I20260808 08:33:37.025537 7429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add1b8ca52d14a32a0e57f242d99ff9b" candidate_uuid: "10e289cc231c41ceb38fbe79c83c3b05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9464caa7ce664f69afefb83fcac4fdd1" is_pre_election: true
I20260808 08:33:37.025810 7429 raft_consensus.cc:2454] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10e289cc231c41ceb38fbe79c83c3b05 in term 0.
I20260808 08:33:37.026368 7060 leader_election.cc:302] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10e289cc231c41ceb38fbe79c83c3b05, 9464caa7ce664f69afefb83fcac4fdd1; no voters:
I20260808 08:33:37.027032 7504 raft_consensus.cc:2781] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:37.027338 7504 raft_consensus.cc:482] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:37.027554 7504 raft_consensus.cc:3037] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:37.031421 7496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.016220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:37445 (local address 127.5.164.194:46289)
0808 08:33:37.016436 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:37.016443 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:37.018547 (+ 2104us) server_negotiation.cc:407] Connection header received
0808 08:33:37.018777 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:37.018786 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:37.018889 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:37.019048 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:37.020838 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.022461 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.028375 (+ 5914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.030313 (+ 1938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.030465 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.030519 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:37.031010 (+ 491us) server_negotiation.cc:299] Negotiation successful
0808 08:33:37.031112 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:33:37.031834 7511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.016209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:46289 (local address 127.5.164.193:37445)
0808 08:33:37.018407 (+ 2198us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:37.018432 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:37.018597 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:37.019057 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:37.019063 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:37.019102 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:37.020580 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:37.020596 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.022626 (+ 2030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.022630 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.028148 (+ 5518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:37.028167 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.030606 (+ 2439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.030613 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.030834 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.030871 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:33:37.030978 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 08:33:37.031180 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1972,"mutex_wait_us":31,"thread_start_us":1495,"threads_started":1}
I20260808 08:33:37.032943 7282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add1b8ca52d14a32a0e57f242d99ff9b" candidate_uuid: "10e289cc231c41ceb38fbe79c83c3b05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc54ace73de42d286acb4f44c92f0bc" is_pre_election: true
I20260808 08:33:37.035180 7506 raft_consensus.cc:504] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } }
I20260808 08:33:37.035204 7504 raft_consensus.cc:504] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } }
I20260808 08:33:37.035975 7504 leader_election.cc:288] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [CANDIDATE]: Term 1 election: Requested vote from peers 9464caa7ce664f69afefb83fcac4fdd1 (127.5.164.195:33055), fdc54ace73de42d286acb4f44c92f0bc (127.5.164.194:46289)
I20260808 08:33:37.036422 7131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add1b8ca52d14a32a0e57f242d99ff9b" candidate_uuid: "fdc54ace73de42d286acb4f44c92f0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10e289cc231c41ceb38fbe79c83c3b05"
I20260808 08:33:37.036831 7131 raft_consensus.cc:2379] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fdc54ace73de42d286acb4f44c92f0bc in current term 1: Already voted for candidate 10e289cc231c41ceb38fbe79c83c3b05 in this term.
I20260808 08:33:37.036772 7429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add1b8ca52d14a32a0e57f242d99ff9b" candidate_uuid: "10e289cc231c41ceb38fbe79c83c3b05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9464caa7ce664f69afefb83fcac4fdd1"
I20260808 08:33:37.036911 7282 raft_consensus.cc:2379] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10e289cc231c41ceb38fbe79c83c3b05 in current term 1: Already voted for candidate fdc54ace73de42d286acb4f44c92f0bc in this term.
I20260808 08:33:37.037016 7429 raft_consensus.cc:3037] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:37.038271 7506 leader_election.cc:288] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [CANDIDATE]: Term 1 election: Requested vote from peers 10e289cc231c41ceb38fbe79c83c3b05 (127.5.164.193:42447), 9464caa7ce664f69afefb83fcac4fdd1 (127.5.164.195:33055)
I20260808 08:33:37.039181 7282 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add1b8ca52d14a32a0e57f242d99ff9b" candidate_uuid: "10e289cc231c41ceb38fbe79c83c3b05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdc54ace73de42d286acb4f44c92f0bc"
I20260808 08:33:37.039511 7282 raft_consensus.cc:2379] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10e289cc231c41ceb38fbe79c83c3b05 in current term 1: Already voted for candidate fdc54ace73de42d286acb4f44c92f0bc in this term.
I20260808 08:33:37.039455 7428 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "add1b8ca52d14a32a0e57f242d99ff9b" candidate_uuid: "fdc54ace73de42d286acb4f44c92f0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9464caa7ce664f69afefb83fcac4fdd1"
I20260808 08:33:37.040413 7429 raft_consensus.cc:2454] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10e289cc231c41ceb38fbe79c83c3b05 in term 1.
I20260808 08:33:37.040532 7208 leader_election.cc:302] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdc54ace73de42d286acb4f44c92f0bc; no voters: 10e289cc231c41ceb38fbe79c83c3b05, 9464caa7ce664f69afefb83fcac4fdd1
I20260808 08:33:37.041112 7506 raft_consensus.cc:2726] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260808 08:33:37.041428 7060 leader_election.cc:302] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10e289cc231c41ceb38fbe79c83c3b05, 9464caa7ce664f69afefb83fcac4fdd1; no voters: fdc54ace73de42d286acb4f44c92f0bc
I20260808 08:33:37.041723 7504 raft_consensus.cc:2781] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:37.042454 7504 raft_consensus.cc:686] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [term 1 LEADER]: Becoming Leader. State: Replica: 10e289cc231c41ceb38fbe79c83c3b05, State: Running, Role: LEADER
I20260808 08:33:37.043226 7504 consensus_queue.cc:237] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } }
I20260808 08:33:37.049230 6966 catalog_manager.cc:5495] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10e289cc231c41ceb38fbe79c83c3b05 (127.5.164.193). New cstate: current_term: 1 leader_uuid: "10e289cc231c41ceb38fbe79c83c3b05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } health_report { overall_health: UNKNOWN } } }
I20260808 08:33:37.125964 7493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.119118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43500 (local address 127.5.164.193:42447)
0808 08:33:37.119333 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:37.119338 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:37.119944 (+ 606us) server_negotiation.cc:407] Connection header received
0808 08:33:37.120277 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:37.120281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:37.120391 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:37.120534 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:37.120983 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.121759 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.123423 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.123877 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.123982 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.124631 (+ 649us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:37.125282 (+ 651us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:37.125401 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:37.125485 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 08:33:37.125559 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 08:33:37.135666 7282 raft_consensus.cc:1261] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [term 1 FOLLOWER]: Refusing update from remote peer 10e289cc231c41ceb38fbe79c83c3b05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:37.136510 7429 raft_consensus.cc:1261] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1 [term 1 FOLLOWER]: Refusing update from remote peer 10e289cc231c41ceb38fbe79c83c3b05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:37.136884 7512 consensus_queue.cc:1035] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:37.137614 7504 consensus_queue.cc:1035] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:37.180897 6965 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:37.181381 6965 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:37.186146 6965 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98: Sending DeleteTablet for 3 replicas of tablet add1b8ca52d14a32a0e57f242d99ff9b
I20260808 08:33:37.188077 7403 tablet_service.cc:1514] Processing DeleteTablet for tablet add1b8ca52d14a32a0e57f242d99ff9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:37 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:58098
I20260808 08:33:37.188304 7256 tablet_service.cc:1514] Processing DeleteTablet for tablet add1b8ca52d14a32a0e57f242d99ff9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:37 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:33498
I20260808 08:33:37.199472 7529 tablet_replica.cc:330] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1: stopping tablet replica
I20260808 08:33:37.188053 7110 tablet_service.cc:1514] Processing DeleteTablet for tablet add1b8ca52d14a32a0e57f242d99ff9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:37 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:43496
I20260808 08:33:37.201476 7529 raft_consensus.cc:2229] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:37.202142 7529 raft_consensus.cc:2258] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:37.203471 6965 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56916:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:33:37.204310 6965 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:33:37.204797 7529 ts_tablet_manager.cc:1905] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:37.208973 7531 tablet_replica.cc:330] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05: stopping tablet replica
I20260808 08:33:37.209136 7530 tablet_replica.cc:330] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc: stopping tablet replica
I20260808 08:33:37.209632 7530 raft_consensus.cc:2229] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:37.210189 7530 raft_consensus.cc:2258] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:37.211592 7531 raft_consensus.cc:2229] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:33:37.212673 7530 ts_tablet_manager.cc:1905] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:37.213083 7531 raft_consensus.cc:2258] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:37.215891 7531 ts_tablet_manager.cc:1905] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:37.217634 7403 tablet_service.cc:1467] Processing CreateTablet for tablet d698f53ab98146f1ad5b281c74964161 (DEFAULT_TABLE table=test-table [id=50ee6e31284b438288031e3403e0c8a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:37.219434 7110 tablet_service.cc:1467] Processing CreateTablet for tablet d698f53ab98146f1ad5b281c74964161 (DEFAULT_TABLE table=test-table [id=50ee6e31284b438288031e3403e0c8a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:37.220075 7110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d698f53ab98146f1ad5b281c74964161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:37.220595 7256 tablet_service.cc:1467] Processing CreateTablet for tablet d698f53ab98146f1ad5b281c74964161 (DEFAULT_TABLE table=test-table [id=50ee6e31284b438288031e3403e0c8a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:37.237643 7403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d698f53ab98146f1ad5b281c74964161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:37.243060 7256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d698f53ab98146f1ad5b281c74964161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:37.246924 7532 tablet_bootstrap.cc:492] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1: Bootstrap starting.
I20260808 08:33:37.249071 7531 ts_tablet_manager.cc:1918] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:37.249608 7531 log.cc:1196] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/add1b8ca52d14a32a0e57f242d99ff9b
I20260808 08:33:37.251055 7531 ts_tablet_manager.cc:1939] T add1b8ca52d14a32a0e57f242d99ff9b P 10e289cc231c41ceb38fbe79c83c3b05: Deleting consensus metadata
I20260808 08:33:37.251794 7532 tablet_bootstrap.cc:654] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:37.256124 7533 tablet_bootstrap.cc:492] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05: Bootstrap starting.
I20260808 08:33:37.258213 7532 tablet_bootstrap.cc:492] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1: No bootstrap required, opened a new log
I20260808 08:33:37.258471 7532 ts_tablet_manager.cc:1397] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.003s
I20260808 08:33:37.259812 7532 raft_consensus.cc:348] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.260162 7533 tablet_bootstrap.cc:654] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:37.260202 7532 raft_consensus.cc:374] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:37.260434 7532 raft_consensus.cc:729] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9464caa7ce664f69afefb83fcac4fdd1, State: Initialized, Role: FOLLOWER
I20260808 08:33:37.260955 7532 consensus_queue.cc:260] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.261934 7532 ts_tablet_manager.cc:1428] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 08:33:37.266315 7533 tablet_bootstrap.cc:492] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05: No bootstrap required, opened a new log
I20260808 08:33:37.266551 7533 ts_tablet_manager.cc:1397] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.006s
I20260808 08:33:37.268159 7533 raft_consensus.cc:348] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.268616 7533 raft_consensus.cc:374] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:37.268898 7533 raft_consensus.cc:729] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10e289cc231c41ceb38fbe79c83c3b05, State: Initialized, Role: FOLLOWER
I20260808 08:33:37.269343 7533 consensus_queue.cc:260] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.270176 7533 ts_tablet_manager.cc:1428] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260808 08:33:37.292285 7520 raft_consensus.cc:482] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:37.292831 7520 raft_consensus.cc:504] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.294739 7520 leader_election.cc:288] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10e289cc231c41ceb38fbe79c83c3b05 (127.5.164.193:42447), fdc54ace73de42d286acb4f44c92f0bc (127.5.164.194:46289)
I20260808 08:33:37.309340 7493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.295862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:42197 (local address 127.5.164.193:42447)
0808 08:33:37.296148 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:37.296157 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:37.300125 (+ 3968us) server_negotiation.cc:407] Connection header received
0808 08:33:37.300761 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:37.300766 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:37.300869 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:37.300980 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:37.302063 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.304154 (+ 2091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.307300 (+ 3146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.308270 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.308499 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.308578 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:37.308862 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 08:33:37.309013 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:33:37.309481 7536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.295046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42447 (local address 127.5.164.195:42197)
0808 08:33:37.299998 (+ 4952us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:37.300021 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:37.300576 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:37.301309 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:37.301313 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:37.301337 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:37.301740 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:37.301755 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.304321 (+ 2566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.304326 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.306544 (+ 2218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:37.306559 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.308502 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.308508 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.308683 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.308709 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 08:33:37.308818 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 08:33:37.308981 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4727,"mutex_wait_us":48,"thread_start_us":4405,"threads_started":1}
I20260808 08:33:37.309945 7496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.295474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:59459 (local address 127.5.164.194:46289)
0808 08:33:37.295682 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:37.295689 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:37.300503 (+ 4814us) server_negotiation.cc:407] Connection header received
0808 08:33:37.301291 (+ 788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:37.301296 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:37.301378 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:37.301475 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:37.302751 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.303711 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.306759 (+ 3048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.308531 (+ 1772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.308716 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.308805 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:37.309467 (+ 662us) server_negotiation.cc:299] Negotiation successful
0808 08:33:37.309619 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:33:37.310747 7131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d698f53ab98146f1ad5b281c74964161" candidate_uuid: "9464caa7ce664f69afefb83fcac4fdd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10e289cc231c41ceb38fbe79c83c3b05" is_pre_election: true
I20260808 08:33:37.311077 7537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.295505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:46289 (local address 127.5.164.195:59459)
0808 08:33:37.300384 (+ 4879us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:37.300399 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:37.301054 (+ 655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:37.301660 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:37.301666 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:37.301698 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:37.302573 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:37.302583 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.303844 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.303852 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.306544 (+ 2692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:37.306559 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.308979 (+ 2420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.308986 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.309242 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.309280 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 08:33:37.310250 (+ 970us) client_negotiation.cc:240] Negotiation successful
0808 08:33:37.310419 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4772,"mutex_wait_us":10,"thread_start_us":4476,"threads_started":1}
I20260808 08:33:37.311124 7131 raft_consensus.cc:2454] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9464caa7ce664f69afefb83fcac4fdd1 in term 0.
I20260808 08:33:37.312070 7352 leader_election.cc:302] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10e289cc231c41ceb38fbe79c83c3b05, 9464caa7ce664f69afefb83fcac4fdd1; no voters:
W20260808 08:33:37.312951 7355 leader_election.cc:341] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fdc54ace73de42d286acb4f44c92f0bc (127.5.164.194:46289): Not found: Tablet not found: d698f53ab98146f1ad5b281c74964161
I20260808 08:33:37.313632 7520 raft_consensus.cc:2781] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:37.313877 7520 raft_consensus.cc:482] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:37.314011 7520 raft_consensus.cc:3037] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:37.320019 6949 catalog_manager.cc:4841] TS 10e289cc231c41ceb38fbe79c83c3b05 (127.5.164.193:42447): tablet add1b8ca52d14a32a0e57f242d99ff9b (table test-table [id=992365e60df2437dba4fa864e7255cb7]) successfully deleted
I20260808 08:33:37.340126 7530 ts_tablet_manager.cc:1918] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:37.340221 7529 ts_tablet_manager.cc:1918] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:33:37.340445 7530 log.cc:1196] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/add1b8ca52d14a32a0e57f242d99ff9b
I20260808 08:33:37.340517 7529 log.cc:1196] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/add1b8ca52d14a32a0e57f242d99ff9b
I20260808 08:33:37.341235 7530 ts_tablet_manager.cc:1939] T add1b8ca52d14a32a0e57f242d99ff9b P fdc54ace73de42d286acb4f44c92f0bc: Deleting consensus metadata
I20260808 08:33:37.341351 7529 ts_tablet_manager.cc:1939] T add1b8ca52d14a32a0e57f242d99ff9b P 9464caa7ce664f69afefb83fcac4fdd1: Deleting consensus metadata
I20260808 08:33:37.343394 7520 raft_consensus.cc:504] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.343590 6951 catalog_manager.cc:4841] TS fdc54ace73de42d286acb4f44c92f0bc (127.5.164.194:46289): tablet add1b8ca52d14a32a0e57f242d99ff9b (table test-table [id=992365e60df2437dba4fa864e7255cb7]) successfully deleted
I20260808 08:33:37.344630 7520 leader_election.cc:288] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [CANDIDATE]: Term 1 election: Requested vote from peers 10e289cc231c41ceb38fbe79c83c3b05 (127.5.164.193:42447), fdc54ace73de42d286acb4f44c92f0bc (127.5.164.194:46289)
I20260808 08:33:37.345906 6951 catalog_manager.cc:4841] TS 9464caa7ce664f69afefb83fcac4fdd1 (127.5.164.195:33055): tablet add1b8ca52d14a32a0e57f242d99ff9b (table test-table [id=992365e60df2437dba4fa864e7255cb7]) successfully deleted
W20260808 08:33:37.346031 7355 leader_election.cc:341] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fdc54ace73de42d286acb4f44c92f0bc (127.5.164.194:46289): Not found: Tablet not found: d698f53ab98146f1ad5b281c74964161
I20260808 08:33:37.347762 7131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d698f53ab98146f1ad5b281c74964161" candidate_uuid: "9464caa7ce664f69afefb83fcac4fdd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10e289cc231c41ceb38fbe79c83c3b05"
I20260808 08:33:37.348028 7131 raft_consensus.cc:3037] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:37.360229 7538 tablet_bootstrap.cc:492] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc: Bootstrap starting.
I20260808 08:33:37.363802 7538 tablet_bootstrap.cc:654] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:37.367906 7538 tablet_bootstrap.cc:492] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc: No bootstrap required, opened a new log
I20260808 08:33:37.368161 7538 ts_tablet_manager.cc:1397] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260808 08:33:37.369480 7538 raft_consensus.cc:348] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.369813 7538 raft_consensus.cc:374] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:37.370075 7538 raft_consensus.cc:729] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc54ace73de42d286acb4f44c92f0bc, State: Initialized, Role: FOLLOWER
I20260808 08:33:37.370519 7538 consensus_queue.cc:260] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.371426 7538 ts_tablet_manager.cc:1428] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 08:33:37.444339 7131 raft_consensus.cc:2454] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9464caa7ce664f69afefb83fcac4fdd1 in term 1.
I20260808 08:33:37.445149 7352 leader_election.cc:302] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10e289cc231c41ceb38fbe79c83c3b05, 9464caa7ce664f69afefb83fcac4fdd1; no voters: fdc54ace73de42d286acb4f44c92f0bc
I20260808 08:33:37.445945 7520 raft_consensus.cc:2781] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:37.452728 7520 raft_consensus.cc:686] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [term 1 LEADER]: Becoming Leader. State: Replica: 9464caa7ce664f69afefb83fcac4fdd1, State: Running, Role: LEADER
I20260808 08:33:37.453445 7520 consensus_queue.cc:237] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.459627 6965 catalog_manager.cc:5495] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9464caa7ce664f69afefb83fcac4fdd1 (127.5.164.195). New cstate: current_term: 1 leader_uuid: "9464caa7ce664f69afefb83fcac4fdd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } health_report { overall_health: HEALTHY } } }
I20260808 08:33:37.477123 7506 raft_consensus.cc:482] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:37.477485 7506 raft_consensus.cc:504] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.478389 7506 leader_election.cc:288] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10e289cc231c41ceb38fbe79c83c3b05 (127.5.164.193:42447), 9464caa7ce664f69afefb83fcac4fdd1 (127.5.164.195:33055)
I20260808 08:33:37.479341 7131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d698f53ab98146f1ad5b281c74964161" candidate_uuid: "fdc54ace73de42d286acb4f44c92f0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10e289cc231c41ceb38fbe79c83c3b05" is_pre_election: true
I20260808 08:33:37.479791 7131 raft_consensus.cc:2379] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fdc54ace73de42d286acb4f44c92f0bc in current term 1: Already voted for candidate 9464caa7ce664f69afefb83fcac4fdd1 in this term.
I20260808 08:33:37.479573 7429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d698f53ab98146f1ad5b281c74964161" candidate_uuid: "fdc54ace73de42d286acb4f44c92f0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9464caa7ce664f69afefb83fcac4fdd1" is_pre_election: true
I20260808 08:33:37.480669 7208 leader_election.cc:302] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fdc54ace73de42d286acb4f44c92f0bc; no voters: 10e289cc231c41ceb38fbe79c83c3b05, 9464caa7ce664f69afefb83fcac4fdd1
I20260808 08:33:37.481024 7506 raft_consensus.cc:3037] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Advancing to term 1
Aug 08 08:33:37 dist-test-slave-chsk krb5kdc[6919](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178014, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:37.550028 7506 raft_consensus.cc:2726] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 08:33:37.552672 7547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.515816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38791 (local address 127.0.0.1:37326)
0808 08:33:37.524136 (+ 8320us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:37.524172 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:37.524326 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:37.524819 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:37.524823 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:37.525922 (+ 1099us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:37.526492 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:37.526504 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.528661 (+ 2157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.528666 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.530507 (+ 1841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:37.530520 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.532375 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.532391 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.532652 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.538961 (+ 6309us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:37.538986 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:37.543419 (+ 4433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:37.548024 (+ 4605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:37.548042 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:37.548064 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:37.549027 (+ 963us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:37.549557 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:37.549562 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:37.549566 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:37.549959 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:37.550820 (+ 861us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:37.550832 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:37.551105 (+ 273us) client_negotiation.cc:769] Sending connection context
0808 08:33:37.551415 (+ 310us) client_negotiation.cc:240] Negotiation successful
0808 08:33:37.551876 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8147,"mutex_wait_us":13,"thread_start_us":7845,"threads_started":1}
I20260808 08:33:37.552923 7548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.515758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37326 (local address 127.5.164.254:38791)
0808 08:33:37.523700 (+ 7942us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:37.523709 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:37.524286 (+ 577us) server_negotiation.cc:407] Connection header received
0808 08:33:37.524469 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:37.524474 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:37.524584 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:37.524733 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:37.526784 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.528479 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.530686 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.531913 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.532158 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.543782 (+ 11624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:37.543792 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:37.543800 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:37.543848 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:37.547778 (+ 3930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:37.549174 (+ 1396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:37.549179 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:37.549181 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:37.549412 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:37.550109 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:37.550114 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:37.550116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:37.550581 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:37.550820 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:37.551522 (+ 702us) server_negotiation.cc:299] Negotiation successful
0808 08:33:37.552135 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":218,"server-negotiator.queue_time_us":7666,"spinlock_wait_cycles":96000,"thread_start_us":7245,"threads_started":1}
I20260808 08:33:37.561057 6965 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:37326:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 08:33:37.563292 6965 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:33:37.572773 7110 tablet_service.cc:1467] Processing CreateTablet for tablet c2756756614149afaf99930ebad1512f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=00be2d42e1cc46bf8840c747ebf9ffff]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:33:37.572986 7403 tablet_service.cc:1467] Processing CreateTablet for tablet c2756756614149afaf99930ebad1512f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=00be2d42e1cc46bf8840c747ebf9ffff]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:33:37.572995 7256 tablet_service.cc:1467] Processing CreateTablet for tablet c2756756614149afaf99930ebad1512f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=00be2d42e1cc46bf8840c747ebf9ffff]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:33:37.573642 7256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2756756614149afaf99930ebad1512f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:37.573665 7403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2756756614149afaf99930ebad1512f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:37.573731 7110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c2756756614149afaf99930ebad1512f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:37.583652 7538 tablet_bootstrap.cc:492] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc: Bootstrap starting.
I20260808 08:33:37.585847 7533 tablet_bootstrap.cc:492] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05: Bootstrap starting.
I20260808 08:33:37.586338 7538 tablet_bootstrap.cc:654] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:37.589498 7533 tablet_bootstrap.cc:654] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:37.590744 7532 tablet_bootstrap.cc:492] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1: Bootstrap starting.
I20260808 08:33:37.592677 7538 tablet_bootstrap.cc:492] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc: No bootstrap required, opened a new log
I20260808 08:33:37.593036 7538 ts_tablet_manager.cc:1397] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 08:33:37.593429 7533 tablet_bootstrap.cc:492] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05: No bootstrap required, opened a new log
I20260808 08:33:37.593627 7533 ts_tablet_manager.cc:1397] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260808 08:33:37.594175 7532 tablet_bootstrap.cc:654] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:37.594108 7538 raft_consensus.cc:348] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.594671 7538 raft_consensus.cc:374] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:37.594874 7538 raft_consensus.cc:729] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdc54ace73de42d286acb4f44c92f0bc, State: Initialized, Role: FOLLOWER
I20260808 08:33:37.594594 7533 raft_consensus.cc:348] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.595085 7533 raft_consensus.cc:374] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:37.595292 7533 raft_consensus.cc:729] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10e289cc231c41ceb38fbe79c83c3b05, State: Initialized, Role: FOLLOWER
I20260808 08:33:37.595306 7538 consensus_queue.cc:260] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.596094 7506 tablet_replica.cc:439] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } }
I20260808 08:33:37.596741 7506 tablet_replica.cc:442] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:33:37.597776 7538 ts_tablet_manager.cc:1428] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260808 08:33:37.595752 7533 consensus_queue.cc:260] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.599201 7533 ts_tablet_manager.cc:1428] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260808 08:33:37.599004 7504 tablet_replica.cc:439] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } }
I20260808 08:33:37.599463 7504 tablet_replica.cc:442] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:33:37.601771 7532 tablet_bootstrap.cc:492] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1: No bootstrap required, opened a new log
I20260808 08:33:37.602113 7532 ts_tablet_manager.cc:1397] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.007s
I20260808 08:33:37.603240 7532 raft_consensus.cc:348] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.603669 7532 raft_consensus.cc:374] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:37.603830 7532 raft_consensus.cc:729] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9464caa7ce664f69afefb83fcac4fdd1, State: Initialized, Role: FOLLOWER
I20260808 08:33:37.604197 7532 consensus_queue.cc:260] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.604923 7520 tablet_replica.cc:439] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } }
I20260808 08:33:37.605379 7520 tablet_replica.cc:442] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:33:37.605952 7532 ts_tablet_manager.cc:1428] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 08:33:37.631904 7506 raft_consensus.cc:482] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:37.632125 7506 raft_consensus.cc:504] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.633383 7506 leader_election.cc:288] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10e289cc231c41ceb38fbe79c83c3b05 (127.5.164.193:42447), 9464caa7ce664f69afefb83fcac4fdd1 (127.5.164.195:33055)
I20260808 08:33:37.633915 7131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2756756614149afaf99930ebad1512f" candidate_uuid: "fdc54ace73de42d286acb4f44c92f0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10e289cc231c41ceb38fbe79c83c3b05" is_pre_election: true
I20260808 08:33:37.633924 7429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2756756614149afaf99930ebad1512f" candidate_uuid: "fdc54ace73de42d286acb4f44c92f0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9464caa7ce664f69afefb83fcac4fdd1" is_pre_election: true
I20260808 08:33:37.634312 7131 raft_consensus.cc:2454] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdc54ace73de42d286acb4f44c92f0bc in term 0.
I20260808 08:33:37.634409 7429 raft_consensus.cc:2454] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdc54ace73de42d286acb4f44c92f0bc in term 0.
I20260808 08:33:37.635001 7206 leader_election.cc:302] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10e289cc231c41ceb38fbe79c83c3b05, fdc54ace73de42d286acb4f44c92f0bc; no voters:
I20260808 08:33:37.635396 7506 raft_consensus.cc:2781] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:37.635538 7506 raft_consensus.cc:482] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:37.635673 7506 raft_consensus.cc:3037] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:37.652752 7506 raft_consensus.cc:504] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.653833 7506 leader_election.cc:288] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [CANDIDATE]: Term 1 election: Requested vote from peers 10e289cc231c41ceb38fbe79c83c3b05 (127.5.164.193:42447), 9464caa7ce664f69afefb83fcac4fdd1 (127.5.164.195:33055)
I20260808 08:33:37.655105 7131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2756756614149afaf99930ebad1512f" candidate_uuid: "fdc54ace73de42d286acb4f44c92f0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10e289cc231c41ceb38fbe79c83c3b05"
I20260808 08:33:37.655349 7429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c2756756614149afaf99930ebad1512f" candidate_uuid: "fdc54ace73de42d286acb4f44c92f0bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9464caa7ce664f69afefb83fcac4fdd1"
I20260808 08:33:37.655437 7131 raft_consensus.cc:3037] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:37.655723 7429 raft_consensus.cc:3037] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:37.755913 7131 raft_consensus.cc:2454] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdc54ace73de42d286acb4f44c92f0bc in term 1.
I20260808 08:33:37.755951 7429 raft_consensus.cc:2454] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdc54ace73de42d286acb4f44c92f0bc in term 1.
I20260808 08:33:37.756757 7206 leader_election.cc:302] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10e289cc231c41ceb38fbe79c83c3b05, fdc54ace73de42d286acb4f44c92f0bc; no voters:
I20260808 08:33:37.757354 7506 raft_consensus.cc:2781] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:37.760119 7506 raft_consensus.cc:686] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [term 1 LEADER]: Becoming Leader. State: Replica: fdc54ace73de42d286acb4f44c92f0bc, State: Running, Role: LEADER
I20260808 08:33:37.760964 7506 consensus_queue.cc:237] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } }
I20260808 08:33:37.763976 7552 tablet_replica.cc:439] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc: TxnStatusTablet state changed. Reason: New leader fdc54ace73de42d286acb4f44c92f0bc. Latest consensus state: current_term: 1 leader_uuid: "fdc54ace73de42d286acb4f44c92f0bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } }
I20260808 08:33:37.764914 7552 tablet_replica.cc:442] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:33:37.765951 7554 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 08:33:37.766314 7554 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 08:33:37.766613 6964 catalog_manager.cc:5495] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc reported cstate change: term changed from 0 to 1, leader changed from <none> to fdc54ace73de42d286acb4f44c92f0bc (127.5.164.194). New cstate: current_term: 1 leader_uuid: "fdc54ace73de42d286acb4f44c92f0bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } health_report { overall_health: UNKNOWN } } }
I20260808 08:33:37.806766 7547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.795878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:46289 (local address 127.0.0.1:56208)
0808 08:33:37.796428 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:37.796450 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:37.796643 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:37.797403 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:37.797409 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:37.797423 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:33:37.797799 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:37.797817 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.800241 (+ 2424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.800248 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.802547 (+ 2299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:37.802564 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.803935 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.803942 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.804318 (+ 376us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.804406 (+ 88us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:33:37.805985 (+ 1579us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:33:37.806019 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:33:37.806109 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 08:33:37.806307 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343}
I20260808 08:33:37.807742 7496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.795942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56208 (local address 127.5.164.194:46289)
0808 08:33:37.796190 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:37.796207 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:37.796551 (+ 344us) server_negotiation.cc:407] Connection header received
0808 08:33:37.796936 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:37.796942 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:37.797147 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:37.797368 (+ 221us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:37.798026 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.800007 (+ 1981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.802716 (+ 2709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.803688 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.803880 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.804740 (+ 860us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:37.805700 (+ 960us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:37.805916 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:37.807212 (+ 1296us) server_negotiation.cc:299] Negotiation successful
0808 08:33:37.807303 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 08:33:37.817714 7429 raft_consensus.cc:1261] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1 [term 1 FOLLOWER]: Refusing update from remote peer fdc54ace73de42d286acb4f44c92f0bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:37.818264 7131 raft_consensus.cc:1261] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05 [term 1 FOLLOWER]: Refusing update from remote peer fdc54ace73de42d286acb4f44c92f0bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:37.819308 7552 consensus_queue.cc:1035] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260808 08:33:37.820708 7506 consensus_queue.cc:1035] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:37.829502 7520 tablet_replica.cc:439] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1: TxnStatusTablet state changed. Reason: New leader fdc54ace73de42d286acb4f44c92f0bc. Latest consensus state: current_term: 1 leader_uuid: "fdc54ace73de42d286acb4f44c92f0bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } }
I20260808 08:33:37.829980 7520 tablet_replica.cc:442] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:33:37.834004 7558 mvcc.cc:205] Tried to move back new op lower bound from 7316185160970739712 to 7316185160755036160. Current Snapshot: MvccSnapshot[applied={T|T < 7316185160970739712}]
I20260808 08:33:37.834942 7506 tablet_replica.cc:439] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fdc54ace73de42d286acb4f44c92f0bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } }
I20260808 08:33:37.835685 7506 tablet_replica.cc:442] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:33:37.853565 7520 tablet_replica.cc:439] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fdc54ace73de42d286acb4f44c92f0bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } }
I20260808 08:33:37.854076 7520 tablet_replica.cc:442] T c2756756614149afaf99930ebad1512f P 9464caa7ce664f69afefb83fcac4fdd1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:33:37.867221 7504 tablet_replica.cc:439] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05: TxnStatusTablet state changed. Reason: New leader fdc54ace73de42d286acb4f44c92f0bc. Latest consensus state: current_term: 1 leader_uuid: "fdc54ace73de42d286acb4f44c92f0bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } }
I20260808 08:33:37.867756 7504 tablet_replica.cc:442] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:33:37.874828 7506 tablet_replica.cc:439] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fdc54ace73de42d286acb4f44c92f0bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } }
I20260808 08:33:37.875216 7506 tablet_replica.cc:442] T c2756756614149afaf99930ebad1512f P fdc54ace73de42d286acb4f44c92f0bc: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:33:37.877498 7559 mvcc.cc:205] Tried to move back new op lower bound from 7316185160970739712 to 7316185160755036160. Current Snapshot: MvccSnapshot[applied={T|T < 7316185160970739712}]
I20260808 08:33:37.881445 7520 consensus_queue.cc:1035] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:37.884428 7565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.859380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60798 (local address 127.5.164.195:33055)
0808 08:33:37.871038 (+ 11658us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:37.871045 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:37.871071 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:33:37.871227 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:37.871234 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:37.871398 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:37.871622 (+ 224us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:37.872935 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.874359 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.879705 (+ 5346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.880763 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.880904 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.881932 (+ 1028us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:37.882920 (+ 988us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:37.883088 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:37.883778 (+ 690us) server_negotiation.cc:299] Negotiation successful
0808 08:33:37.883867 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11481,"thread_start_us":12075,"threads_started":1}
I20260808 08:33:37.926985 7540 consensus_queue.cc:1035] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260808 08:33:37.929088 7504 tablet_replica.cc:439] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fdc54ace73de42d286acb4f44c92f0bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10e289cc231c41ceb38fbe79c83c3b05" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42447 } } peers { permanent_uuid: "fdc54ace73de42d286acb4f44c92f0bc" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46289 } } peers { permanent_uuid: "9464caa7ce664f69afefb83fcac4fdd1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 33055 } } }
I20260808 08:33:37.929529 7504 tablet_replica.cc:442] T c2756756614149afaf99930ebad1512f P 10e289cc231c41ceb38fbe79c83c3b05: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:33:37.945922 7496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.917760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:59953 (local address 127.5.164.194:46289)
0808 08:33:37.918003 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:37.918010 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:37.932650 (+ 14640us) server_negotiation.cc:407] Connection header received
0808 08:33:37.933059 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:37.933064 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:37.933147 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:37.933205 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:37.934701 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.936872 (+ 2171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.940335 (+ 3463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.941900 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.942073 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.944704 (+ 2631us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:37.944872 (+ 168us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:37.944966 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:37.945164 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 08:33:37.945280 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:33:37.947580 7571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:37.916887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:46289 (local address 127.5.164.195:59953)
0808 08:33:37.932490 (+ 15603us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:37.932516 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:37.932867 (+ 351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:37.933371 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:37.933376 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:37.933388 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:33:37.934441 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:37.934462 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.937150 (+ 2688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.937155 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.940105 (+ 2950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:37.940138 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:37.942321 (+ 2183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:37.942327 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:37.942598 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:37.942669 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:33:37.945020 (+ 2351us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:33:37.945031 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 08:33:37.946394 (+ 1363us) client_negotiation.cc:240] Negotiation successful
0808 08:33:37.946651 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15290,"thread_start_us":17096,"threads_started":1}
I20260808 08:33:38.033219 7565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:38.017151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:36821 (local address 127.5.164.195:33055)
0808 08:33:38.017352 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:38.017358 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:38.021361 (+ 4003us) server_negotiation.cc:407] Connection header received
0808 08:33:38.021789 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:38.021795 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:38.021903 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:38.021969 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:38.025089 (+ 3120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:38.026698 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:38.030175 (+ 3477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:38.031186 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:38.031305 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:38.032098 (+ 793us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:38.032265 (+ 167us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:38.032380 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:38.032580 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 08:33:38.032696 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:33:38.034174 7576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:38.016324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:33055 (local address 127.5.164.194:36821)
0808 08:33:38.021251 (+ 4927us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:38.021274 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:38.021571 (+ 297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:38.023333 (+ 1762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:38.023340 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:38.023355 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:33:38.024785 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:38.024801 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:38.026897 (+ 2096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:38.026902 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:38.029967 (+ 3065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:38.029983 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:38.031391 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:38.031399 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:38.031715 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:38.031797 (+ 82us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:33:38.032402 (+ 605us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:33:38.032415 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 08:33:38.032493 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 08:33:38.032703 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4597,"thread_start_us":4211,"threads_started":1}
I20260808 08:33:38.092514 6965 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:38.092860 6965 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56916:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:38.097615 6965 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a509317edadc4939b185cb2248a01a98: Sending DeleteTablet for 3 replicas of tablet d698f53ab98146f1ad5b281c74964161
I20260808 08:33:38.098713 7110 tablet_service.cc:1514] Processing DeleteTablet for tablet d698f53ab98146f1ad5b281c74964161 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:38 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:43496
I20260808 08:33:38.098830 7256 tablet_service.cc:1514] Processing DeleteTablet for tablet d698f53ab98146f1ad5b281c74964161 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:38 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:33498
I20260808 08:33:38.100176 7403 tablet_service.cc:1514] Processing DeleteTablet for tablet d698f53ab98146f1ad5b281c74964161 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:38 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:58098
I20260808 08:33:38.113911 7580 tablet_replica.cc:330] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc: stopping tablet replica
I20260808 08:33:38.114396 7580 raft_consensus.cc:2229] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:38.115269 7580 raft_consensus.cc:2258] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:38.117028 7580 ts_tablet_manager.cc:1905] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:38.125705 7581 tablet_replica.cc:330] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1: stopping tablet replica
I20260808 08:33:38.126684 7579 tablet_replica.cc:330] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05: stopping tablet replica
I20260808 08:33:38.127358 7579 raft_consensus.cc:2229] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:38.127822 7581 raft_consensus.cc:2229] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:33:38.128366 7579 raft_consensus.cc:2258] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:38.129385 7581 raft_consensus.cc:2258] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:38.130870 7579 ts_tablet_manager.cc:1905] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:38.132409 7581 ts_tablet_manager.cc:1905] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 08:33:38 dist-test-slave-chsk krb5kdc[6919](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178016, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:33:38.164469 7583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:38.124007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45400 (local address 127.5.164.193:42447)
0808 08:33:38.140188 (+ 16181us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:38.140195 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:38.140218 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:33:38.140289 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:38.140294 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:38.140371 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:38.140473 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:38.144383 (+ 3910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:38.146029 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:38.148033 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:38.148692 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:38.148851 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:38.155444 (+ 6593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:38.155478 (+ 34us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:38.155517 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:38.155581 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:38.160257 (+ 4676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:38.161340 (+ 1083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:38.161348 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:38.161350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:38.161534 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:38.162032 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:38.162038 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:38.162041 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:38.162551 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:38.163059 (+ 508us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:38.163421 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 08:33:38.163744 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15922,"thread_start_us":18085,"threads_started":1}
W20260808 08:33:38.165426 7180 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45400
I20260808 08:33:38.215893 7579 ts_tablet_manager.cc:1918] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:33:38.216174 7579 log.cc:1196] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/d698f53ab98146f1ad5b281c74964161
I20260808 08:33:38.217077 7579 ts_tablet_manager.cc:1939] T d698f53ab98146f1ad5b281c74964161 P 10e289cc231c41ceb38fbe79c83c3b05: Deleting consensus metadata
I20260808 08:33:38.218633 7580 ts_tablet_manager.cc:1918] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:33:38.218807 7580 log.cc:1196] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/d698f53ab98146f1ad5b281c74964161
I20260808 08:33:38.219714 7580 ts_tablet_manager.cc:1939] T d698f53ab98146f1ad5b281c74964161 P fdc54ace73de42d286acb4f44c92f0bc: Deleting consensus metadata
I20260808 08:33:38.220153 6949 catalog_manager.cc:4841] TS 10e289cc231c41ceb38fbe79c83c3b05 (127.5.164.193:42447): tablet d698f53ab98146f1ad5b281c74964161 (table test-table [id=50ee6e31284b438288031e3403e0c8a7]) successfully deleted
I20260808 08:33:38.220342 7581 ts_tablet_manager.cc:1918] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:33:38.220517 7581 log.cc:1196] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/d698f53ab98146f1ad5b281c74964161
I20260808 08:33:38.221505 7581 ts_tablet_manager.cc:1939] T d698f53ab98146f1ad5b281c74964161 P 9464caa7ce664f69afefb83fcac4fdd1: Deleting consensus metadata
I20260808 08:33:38.239255 7587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:38.169500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37332 (local address 127.5.164.254:38791)
0808 08:33:38.208952 (+ 39452us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:38.208963 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:38.211629 (+ 2666us) server_negotiation.cc:407] Connection header received
0808 08:33:38.211709 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:38.211715 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:38.211797 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:38.211894 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:38.221044 (+ 9150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:38.222595 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:38.224692 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:38.225412 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:38.225572 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:38.231522 (+ 5950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:38.231531 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:38.231553 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:38.231619 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:38.235726 (+ 4107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:38.236619 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:38.236624 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:38.236626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:38.236789 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:38.237220 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:38.237230 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:38.237232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:38.237581 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:38.238050 (+ 469us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:38.238260 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 08:33:38.238644 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39189,"thread_start_us":39516,"threads_started":1}
W20260808 08:33:38.240235 6965 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37332
I20260808 08:33:38.242982 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 7042
I20260808 08:33:38.263552 6951 catalog_manager.cc:4841] TS fdc54ace73de42d286acb4f44c92f0bc (127.5.164.194:46289): tablet d698f53ab98146f1ad5b281c74964161 (table test-table [id=50ee6e31284b438288031e3403e0c8a7]) successfully deleted
I20260808 08:33:38.268457 7583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:38.245373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45410 (local address 127.5.164.193:42447)
0808 08:33:38.245803 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:38.245812 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:38.247677 (+ 1865us) server_negotiation.cc:407] Connection header received
0808 08:33:38.247882 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:38.247888 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:38.247980 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:38.248095 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:38.250096 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:38.250994 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:38.255326 (+ 4332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:38.256440 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:38.256597 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:38.259105 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:38.259110 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:38.259113 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:38.259235 (+ 122us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:38.264907 (+ 5672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:38.265738 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:38.265746 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:38.265749 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:38.265936 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:38.266467 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:38.266473 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:38.266477 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:38.266785 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:38.267066 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:38.267491 (+ 425us) server_negotiation.cc:299] Negotiation successful
0808 08:33:38.267851 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226}
W20260808 08:33:38.269229 7180 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45410
W20260808 08:33:38.269961 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 7042: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:33:38.270313 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 7042
I20260808 08:33:38.300747 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 7189
Aug 08 08:33:38 dist-test-slave-chsk krb5kdc[6919](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178016, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:33:38.318468 6951 catalog_manager.cc:4841] TS 9464caa7ce664f69afefb83fcac4fdd1 (127.5.164.195:33055): tablet d698f53ab98146f1ad5b281c74964161 (table test-table [id=50ee6e31284b438288031e3403e0c8a7]) successfully deleted
I20260808 08:33:38.322139 7496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:38.301640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56210 (local address 127.5.164.194:46289)
0808 08:33:38.301838 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:38.301846 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:38.301945 (+ 99us) server_negotiation.cc:407] Connection header received
0808 08:33:38.302199 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:38.302204 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:38.302288 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:38.302401 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:38.303682 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:38.304485 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:38.305796 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:38.306252 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:38.306408 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:38.311406 (+ 4998us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:38.311417 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:38.311432 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:38.311466 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:38.315067 (+ 3601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:38.316022 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:38.316031 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:38.316035 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:38.316306 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:38.316715 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:38.316720 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:38.316723 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:38.317191 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:38.321065 (+ 3874us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:38.321458 (+ 393us) server_negotiation.cc:299] Negotiation successful
0808 08:33:38.321713 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260808 08:33:38.322906 7326 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56210
W20260808 08:33:38.323782 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 7189: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:33:38.323999 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 7189
I20260808 08:33:38.348906 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 7336
Aug 08 08:33:38 dist-test-slave-chsk krb5kdc[6919](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178016, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:33:38.367594 7565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:38.349759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60812 (local address 127.5.164.195:33055)
0808 08:33:38.349991 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:38.349999 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:38.350027 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:33:38.350243 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:38.350249 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:38.350352 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:38.350464 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:38.351936 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:38.352744 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:38.354195 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:38.354647 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:38.354788 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:38.360058 (+ 5270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:38.360081 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:38.360101 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:38.360150 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:38.364401 (+ 4251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:38.365376 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:38.365383 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:38.365385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:38.365525 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:38.365946 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:38.365949 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:38.365951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:38.366330 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:38.366593 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:38.366922 (+ 329us) server_negotiation.cc:299] Negotiation successful
0808 08:33:38.367115 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260808 08:33:38.368417 7472 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60812
W20260808 08:33:38.369117 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 7336: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:33:38.369279 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 7336
I20260808 08:33:38.387648 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 6933
I20260808 08:33:38.388897 7009 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:33:38.509234 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 6933
2026-08-08T08:33:38Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5534 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:33:38 dist-test-slave-chsk krb5kdc[7593](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:33:38 dist-test-slave-chsk krb5kdc[7593](info): set up 2 sockets
Aug 08 08:33:38 dist-test-slave-chsk krb5kdc[7593](info): commencing operation
krb5kdc: starting...
W20260808 08:33:39.653486 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.002s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:33:39 dist-test-slave-chsk krb5kdc[7593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:33:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:33:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:33:39.863435 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:44357
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:33315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:44357
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:40.188696 7606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:40.189080 7606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:40.189244 7606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:40.196900 7606 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:40.197073 7606 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 08:33:40.197165 7606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:40.197284 7606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:40.197371 7606 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:40.197465 7606 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:40.207712 7606 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:33315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:44357
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:44357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:40.209089 7606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:40.210489 7606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:40.222693 7615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:40.222738 7613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:40.222846 7612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:40.223848 7606 server_base.cc:1034] running on GCE node
I20260808 08:33:40.224627 7606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:40.226014 7606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:40.227263 7606 hybrid_clock.cc:648] HybridClock initialized: now 1786178020227255 us; error 98 us; skew 500 ppm
I20260808 08:33:40.227612 7606 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:40 dist-test-slave-chsk krb5kdc[7593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178020, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:40.230810 7606 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:33:40.232467 7606 webserver.cc:460] Webserver started at http://127.5.164.254:37483/ using document root <none> and password file <none>
I20260808 08:33:40.233206 7606 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:40.233345 7606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:40.233668 7606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:40.236694 7606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "d838b47aef8a4c0ba54f1c8576fbd20c"
format_stamp: "Formatted at 2026-08-08 08:33:40 on dist-test-slave-chsk"
server_key: "823caf314ca4d5ada462d618298ba0e0"
server_key_iv: "3e7a9d3857244b485c6ffadece06e64d"
server_key_version: "encryptionkey@0"
I20260808 08:33:40.237473 7606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "d838b47aef8a4c0ba54f1c8576fbd20c"
format_stamp: "Formatted at 2026-08-08 08:33:40 on dist-test-slave-chsk"
server_key: "823caf314ca4d5ada462d618298ba0e0"
server_key_iv: "3e7a9d3857244b485c6ffadece06e64d"
server_key_version: "encryptionkey@0"
I20260808 08:33:40.243541 7606 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:33:40.246873 7624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:40.248243 7606 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:33:40.248430 7606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "d838b47aef8a4c0ba54f1c8576fbd20c"
format_stamp: "Formatted at 2026-08-08 08:33:40 on dist-test-slave-chsk"
server_key: "823caf314ca4d5ada462d618298ba0e0"
server_key_iv: "3e7a9d3857244b485c6ffadece06e64d"
server_key_version: "encryptionkey@0"
I20260808 08:33:40.248659 7606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:40.263482 7606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:40.267270 7606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:40.267542 7606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:40.289629 7606 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:44357
I20260808 08:33:40.289652 7690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:44357 every 8 connection(s)
I20260808 08:33:40.291092 7606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:40.292765 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 7606
I20260808 08:33:40.292984 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:33:40.293857 5779 external_mini_cluster.cc:1428] Setting key a816851b668eff878e48fc3203a18aca
I20260808 08:33:40.295769 7691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:40.307008 7691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c: Bootstrap starting.
Aug 08 08:33:40 dist-test-slave-chsk krb5kdc[7593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178019, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:40.310901 7691 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:40.312155 7691 log.cc:824] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:40.315659 7691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c: No bootstrap required, opened a new log
I20260808 08:33:40.316114 7694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:40.295949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53998 (local address 127.5.164.254:44357)
0808 08:33:40.296696 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:40.296708 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:40.296747 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:33:40.298329 (+ 1582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:40.298349 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:40.298710 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:40.299121 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:40.300670 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:40.301967 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:40.303209 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:40.303887 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:40.304113 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:40.308505 (+ 4392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:40.308514 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:40.308529 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:40.308573 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:40.311814 (+ 3241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:40.312664 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:40.312670 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:40.312676 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:40.312946 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:40.313342 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:40.313349 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:40.313357 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:40.313969 (+ 612us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:40.314198 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:40.314681 (+ 483us) server_negotiation.cc:299] Negotiation successful
0808 08:33:40.315005 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":335,"threads_started":1}
I20260808 08:33:40.323037 7691 raft_consensus.cc:348] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d838b47aef8a4c0ba54f1c8576fbd20c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 44357 } }
I20260808 08:33:40.323480 7691 raft_consensus.cc:374] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:40.323594 7691 raft_consensus.cc:729] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d838b47aef8a4c0ba54f1c8576fbd20c, State: Initialized, Role: FOLLOWER
I20260808 08:33:40.324113 7691 consensus_queue.cc:260] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d838b47aef8a4c0ba54f1c8576fbd20c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 44357 } }
I20260808 08:33:40.324355 7691 raft_consensus.cc:388] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:40.324498 7691 raft_consensus.cc:482] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:40.324685 7691 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:40.326790 7691 raft_consensus.cc:504] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d838b47aef8a4c0ba54f1c8576fbd20c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 44357 } }
I20260808 08:33:40.327346 7691 leader_election.cc:302] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d838b47aef8a4c0ba54f1c8576fbd20c; no voters:
I20260808 08:33:40.327927 7691 leader_election.cc:288] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:33:40.328063 7696 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:40.329401 7696 raft_consensus.cc:686] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [term 1 LEADER]: Becoming Leader. State: Replica: d838b47aef8a4c0ba54f1c8576fbd20c, State: Running, Role: LEADER
I20260808 08:33:40.329978 7696 consensus_queue.cc:237] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d838b47aef8a4c0ba54f1c8576fbd20c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 44357 } }
I20260808 08:33:40.330191 7691 sys_catalog.cc:564] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:40.333158 7698 sys_catalog.cc:455] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d838b47aef8a4c0ba54f1c8576fbd20c. Latest consensus state: current_term: 1 leader_uuid: "d838b47aef8a4c0ba54f1c8576fbd20c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d838b47aef8a4c0ba54f1c8576fbd20c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 44357 } } }
I20260808 08:33:40.333266 7697 sys_catalog.cc:455] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d838b47aef8a4c0ba54f1c8576fbd20c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d838b47aef8a4c0ba54f1c8576fbd20c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 44357 } } }
I20260808 08:33:40.333540 7698 sys_catalog.cc:458] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:40.333634 7697 sys_catalog.cc:458] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:40.335621 7704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:40.341361 7704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:40.349504 7704 catalog_manager.cc:1347] Generated new cluster ID: adaa72471e3445828cf73445e08f62f2
I20260808 08:33:40.349634 7704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:40.374256 7704 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:33:40.375589 7704 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:40.380995 7704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c: Generated new TSK 0
I20260808 08:33:40.381788 7704 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:33:40.443380 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:44357
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:33315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:40.775820 7719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:40.776088 7719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:40.776201 7719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:40.783411 7719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:40.783520 7719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:40.783615 7719 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 08:33:40.783669 7719 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:33:40.783740 7719 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:33:40.793574 7719 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:33315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.164.254:44357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:40.794759 7719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:40.796109 7719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:40.810040 7727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:40.810086 7729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:40.810113 7726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:40.811254 7719 server_base.cc:1034] running on GCE node
I20260808 08:33:40.811833 7719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:40.812728 7719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:40.813961 7719 hybrid_clock.cc:648] HybridClock initialized: now 1786178020813919 us; error 32 us; skew 500 ppm
I20260808 08:33:40.814285 7719 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:40 dist-test-slave-chsk krb5kdc[7593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178020, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:40.817641 7719 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:33:40.819280 7719 webserver.cc:460] Webserver started at http://127.5.164.193:34721/ using document root <none> and password file <none>
I20260808 08:33:40.819978 7719 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:40.820137 7719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:40.820470 7719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:40.823717 7719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "73b3fac3ffe14eec84694e3d145be193"
format_stamp: "Formatted at 2026-08-08 08:33:40 on dist-test-slave-chsk"
server_key: "8056c50244c8f7839f3d7add51675456"
server_key_iv: "47be1f5153dfcb1e076a3583b58daf1e"
server_key_version: "encryptionkey@0"
I20260808 08:33:40.824487 7719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "73b3fac3ffe14eec84694e3d145be193"
format_stamp: "Formatted at 2026-08-08 08:33:40 on dist-test-slave-chsk"
server_key: "8056c50244c8f7839f3d7add51675456"
server_key_iv: "47be1f5153dfcb1e076a3583b58daf1e"
server_key_version: "encryptionkey@0"
I20260808 08:33:40.829743 7719 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:33:40.833606 7736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:40.835024 7719 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:33:40.835253 7719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "73b3fac3ffe14eec84694e3d145be193"
format_stamp: "Formatted at 2026-08-08 08:33:40 on dist-test-slave-chsk"
server_key: "8056c50244c8f7839f3d7add51675456"
server_key_iv: "47be1f5153dfcb1e076a3583b58daf1e"
server_key_version: "encryptionkey@0"
I20260808 08:33:40.835479 7719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:40.853175 7719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:40.857389 7719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:40.857709 7719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:40.860539 7719 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:40.860710 7719 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:40.860888 7719 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:40.860999 7719 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:33:40 dist-test-slave-chsk krb5kdc[7593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178020, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:40.883184 7745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:40.860999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:47765 (local address 127.5.164.254:44357)
0808 08:33:40.861579 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:40.861586 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:40.862840 (+ 1254us) server_negotiation.cc:407] Connection header received
0808 08:33:40.865021 (+ 2181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:40.865028 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:40.865140 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:40.865296 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:40.867559 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:40.868633 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:40.871365 (+ 2732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:40.871985 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:40.872151 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:40.877027 (+ 4876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:40.877033 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:40.877036 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:40.877069 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:40.879755 (+ 2686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:40.880598 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:40.880605 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:40.880608 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:40.880775 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:40.881358 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:40.881361 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:40.881363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:40.881634 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:40.881799 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:40.882514 (+ 715us) server_negotiation.cc:299] Negotiation successful
0808 08:33:40.882738 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":265,"threads_started":1}
I20260808 08:33:40.884683 7747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:40.861666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:44357 (local address 127.5.164.193:47765)
0808 08:33:40.862647 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:40.862707 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:40.864716 (+ 2009us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:40.865596 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:40.865608 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:40.866349 (+ 741us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:40.867340 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:40.867377 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:40.868826 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:40.868831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:40.871103 (+ 2272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:40.871122 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:40.872480 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:40.872485 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:40.872683 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:40.873435 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:40.873475 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:40.876782 (+ 3307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:40.879911 (+ 3129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:40.879927 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:40.879942 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:40.880465 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:40.880929 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:40.880932 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:40.880935 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:40.881207 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:40.881772 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:40.881780 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:40.882155 (+ 375us) client_negotiation.cc:769] Sending connection context
0808 08:33:40.882426 (+ 271us) client_negotiation.cc:240] Negotiation successful
0808 08:33:40.882990 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"thread_start_us":417,"threads_started":1}
I20260808 08:33:40.905821 7745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:40.890513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:55147 (local address 127.5.164.254:44357)
0808 08:33:40.890666 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:40.890670 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:40.891794 (+ 1124us) server_negotiation.cc:407] Connection header received
0808 08:33:40.891986 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:40.891993 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:40.892062 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:40.892165 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:40.893087 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:40.893797 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:40.895120 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:40.895587 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:40.895745 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:40.898658 (+ 2913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:40.898663 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:40.898666 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:40.898699 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:40.902239 (+ 3540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:40.903347 (+ 1108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:40.903355 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:40.903360 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:40.903538 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:40.904051 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:40.904056 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:40.904060 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:40.904480 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:40.904685 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:40.905205 (+ 520us) server_negotiation.cc:299] Negotiation successful
0808 08:33:40.905445 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 08:33:40.905977 7795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:40.890517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:44357 (local address 127.5.164.193:55147)
0808 08:33:40.891685 (+ 1168us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:40.891709 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:40.891868 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:40.892190 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:40.892194 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:40.892650 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:40.892943 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:40.892952 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:40.893943 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:40.893948 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:40.894982 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:40.894993 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:40.895856 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:40.895863 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:40.896198 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:40.896967 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:40.897000 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:40.898417 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:40.902392 (+ 3975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:40.902402 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:40.902408 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:40.903201 (+ 793us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:40.903677 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:40.903682 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:40.903689 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:40.903896 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:40.904648 (+ 752us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:40.904658 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:40.904910 (+ 252us) client_negotiation.cc:769] Sending connection context
0808 08:33:40.905091 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 08:33:40.905470 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1048,"thread_start_us":628,"threads_started":1}
I20260808 08:33:40.923395 7719 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:45707
I20260808 08:33:40.923452 7865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:45707 every 8 connection(s)
I20260808 08:33:40.924718 7719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:33:40.927065 7866 heartbeater.cc:347] Connected to a master server at 127.5.164.254:44357
I20260808 08:33:40.927297 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 7719
I20260808 08:33:40.927368 7866 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:40.927529 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:33:40.928228 7866 heartbeater.cc:511] Master 127.5.164.254:44357 requested a full tablet report, sending...
I20260808 08:33:40.928385 5779 external_mini_cluster.cc:1428] Setting key aa7cef286ee2dda9b51750f77b4d7e7c
I20260808 08:33:40.930658 7642 ts_manager.cc:194] Registered new tserver with Master: 73b3fac3ffe14eec84694e3d145be193 (127.5.164.193:45707)
I20260808 08:33:40.932140 7642 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:47765
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:33:40.978550 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:44357
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:33315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:41.329638 7870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:41.329946 7870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:41.330053 7870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:41.337572 7870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:41.337692 7870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:41.337777 7870 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 08:33:41.337829 7870 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:33:41.337899 7870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:33:41.348176 7870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:33315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.164.254:44357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:41.349454 7870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:41.350755 7870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:41.364809 7878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:41.364799 7876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:41.364882 7875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:41.368676 7870 server_base.cc:1034] running on GCE node
I20260808 08:33:41.369326 7870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:41.370301 7870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:41.371543 7870 hybrid_clock.cc:648] HybridClock initialized: now 1786178021371488 us; error 32 us; skew 500 ppm
I20260808 08:33:41.371862 7870 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:41 dist-test-slave-chsk krb5kdc[7593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178021, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:41.375067 7870 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:33:41.376663 7870 webserver.cc:460] Webserver started at http://127.5.164.194:41851/ using document root <none> and password file <none>
I20260808 08:33:41.377365 7870 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:41.377517 7870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:41.377835 7870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:41.380942 7870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "b21088cfc70f4d2ba436fbb63d67c175"
format_stamp: "Formatted at 2026-08-08 08:33:41 on dist-test-slave-chsk"
server_key: "fc4f5d34f4ece79f268fbe61c709fb24"
server_key_iv: "cc1150f9ddc9066b45ddc1db112fdf8a"
server_key_version: "encryptionkey@0"
I20260808 08:33:41.381760 7870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "b21088cfc70f4d2ba436fbb63d67c175"
format_stamp: "Formatted at 2026-08-08 08:33:41 on dist-test-slave-chsk"
server_key: "fc4f5d34f4ece79f268fbe61c709fb24"
server_key_iv: "cc1150f9ddc9066b45ddc1db112fdf8a"
server_key_version: "encryptionkey@0"
I20260808 08:33:41.387213 7870 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 08:33:41.390899 7886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:41.392428 7870 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:33:41.392638 7870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "b21088cfc70f4d2ba436fbb63d67c175"
format_stamp: "Formatted at 2026-08-08 08:33:41 on dist-test-slave-chsk"
server_key: "fc4f5d34f4ece79f268fbe61c709fb24"
server_key_iv: "cc1150f9ddc9066b45ddc1db112fdf8a"
server_key_version: "encryptionkey@0"
I20260808 08:33:41.392843 7870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:41.416675 7870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:41.420900 7870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:41.421175 7870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:41.424772 7870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:41.424902 7870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:41.425035 7870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:41.425197 7870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 08 08:33:41 dist-test-slave-chsk krb5kdc[7593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178021, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:41.455130 7895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:41.425326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:32977 (local address 127.5.164.254:44357)
0808 08:33:41.434732 (+ 9406us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:41.434741 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:41.434769 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:33:41.434845 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:41.434853 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:41.434972 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:41.435122 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:41.437792 (+ 2670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:41.439008 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:41.440906 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:41.441344 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:41.441486 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:41.446443 (+ 4957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:41.446452 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:41.446459 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:41.446517 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:41.450035 (+ 3518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:41.451349 (+ 1314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:41.451356 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:41.451360 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:41.451518 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:41.452175 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:41.452179 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:41.452186 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:41.452626 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:41.452776 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:41.454149 (+ 1373us) server_negotiation.cc:299] Negotiation successful
0808 08:33:41.454508 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9215,"thread_start_us":9104,"threads_started":1}
I20260808 08:33:41.455884 7896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:41.425942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:44357 (local address 127.5.164.194:32977)
0808 08:33:41.427096 (+ 1154us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:41.427182 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:41.431061 (+ 3879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:41.435485 (+ 4424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:41.435499 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:41.436433 (+ 934us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:41.437571 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:41.437605 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:41.439225 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:41.439232 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:41.440753 (+ 1521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:41.440766 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:41.441597 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:41.441605 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:41.441834 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:41.442592 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:41.442616 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:41.446135 (+ 3519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:41.450215 (+ 4080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:41.450225 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:41.450255 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:41.451129 (+ 874us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:41.451644 (+ 515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:41.451649 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:41.451652 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:41.452005 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:41.452929 (+ 924us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:41.452938 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:41.453582 (+ 644us) client_negotiation.cc:769] Sending connection context
0808 08:33:41.453966 (+ 384us) client_negotiation.cc:240] Negotiation successful
0808 08:33:41.454490 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":754,"thread_start_us":423,"threads_started":1}
I20260808 08:33:41.480806 7970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:41.463817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:44357 (local address 127.5.164.194:48675)
0808 08:33:41.464719 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:41.464746 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:41.464942 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:41.465324 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:41.465332 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:41.466177 (+ 845us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:41.466690 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:41.466709 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:41.468028 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:41.468032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:41.469999 (+ 1967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:41.470013 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:41.471060 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:41.471070 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:41.471360 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:41.472369 (+ 1009us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:41.472398 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:41.473957 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:41.477297 (+ 3340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:41.477310 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:41.477320 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:41.478123 (+ 803us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:41.478525 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:41.478533 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:41.478539 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:41.478762 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:41.479403 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:41.479412 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:41.479674 (+ 262us) client_negotiation.cc:769] Sending connection context
0808 08:33:41.479874 (+ 200us) client_negotiation.cc:240] Negotiation successful
0808 08:33:41.480190 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":378,"threads_started":1}
I20260808 08:33:41.481706 7895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:41.463820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:48675 (local address 127.5.164.254:44357)
0808 08:33:41.464029 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:41.464038 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:41.464858 (+ 820us) server_negotiation.cc:407] Connection header received
0808 08:33:41.465091 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:41.465095 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:41.465164 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:41.465247 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:41.466892 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:41.467833 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:41.470158 (+ 2325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:41.470815 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:41.470979 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:41.474172 (+ 3193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:41.474176 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:41.474180 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:41.474213 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:41.477119 (+ 2906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:41.478277 (+ 1158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:41.478282 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:41.478284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:41.478400 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:41.478882 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:41.478885 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:41.478887 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:41.479273 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:41.479452 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:41.481194 (+ 1742us) server_negotiation.cc:299] Negotiation successful
0808 08:33:41.481457 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:33:41.492682 7870 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:36651
I20260808 08:33:41.492782 8017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:36651 every 8 connection(s)
I20260808 08:33:41.494447 7870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:33:41.497098 8018 heartbeater.cc:347] Connected to a master server at 127.5.164.254:44357
I20260808 08:33:41.497370 8018 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:41.498150 8018 heartbeater.cc:511] Master 127.5.164.254:44357 requested a full tablet report, sending...
I20260808 08:33:41.499677 7642 ts_manager.cc:194] Registered new tserver with Master: b21088cfc70f4d2ba436fbb63d67c175 (127.5.164.194:36651)
I20260808 08:33:41.500631 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 7870
I20260808 08:33:41.500618 7642 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:32977
I20260808 08:33:41.500816 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:33:41.501389 5779 external_mini_cluster.cc:1428] Setting key d665771edec6cdb50ca5944bed23d10e
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:33:41.550871 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:44357
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:33315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:41.881919 8022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:41.882272 8022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:41.882447 8022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:41.889999 8022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:41.890163 8022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:41.890311 8022 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 08:33:41.890403 8022 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:33:41.890534 8022 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:33:41.901129 8022 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:33315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.164.254:44357
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:41.902626 8022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:41.904183 8022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:41.917290 8027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:41.917567 8031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:41.917599 8028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:41.918727 8022 server_base.cc:1034] running on GCE node
I20260808 08:33:41.919445 8022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:41.920423 8022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:41.921658 8022 hybrid_clock.cc:648] HybridClock initialized: now 1786178021921622 us; error 62 us; skew 500 ppm
I20260808 08:33:41.921996 8022 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:41 dist-test-slave-chsk krb5kdc[7593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178021, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:41.925249 8022 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:33:41.926925 8022 webserver.cc:460] Webserver started at http://127.5.164.195:44525/ using document root <none> and password file <none>
I20260808 08:33:41.927690 8022 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:41.927829 8022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:41.928169 8022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:41.931318 8022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "d46f4e0b42b24e6588d12a139ccda22e"
format_stamp: "Formatted at 2026-08-08 08:33:41 on dist-test-slave-chsk"
server_key: "bf5438358c3b00457198a58ca520251b"
server_key_iv: "63341924e4aae2f462fcf06cd2a00355"
server_key_version: "encryptionkey@0"
I20260808 08:33:41.932158 8022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "d46f4e0b42b24e6588d12a139ccda22e"
format_stamp: "Formatted at 2026-08-08 08:33:41 on dist-test-slave-chsk"
server_key: "bf5438358c3b00457198a58ca520251b"
server_key_iv: "63341924e4aae2f462fcf06cd2a00355"
server_key_version: "encryptionkey@0"
I20260808 08:33:41.934943 7866 heartbeater.cc:503] Master 127.5.164.254:44357 was elected leader, sending a full tablet report...
I20260808 08:33:41.938107 8022 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260808 08:33:41.941813 8038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:41.943408 8022 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:33:41.943549 8022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "d46f4e0b42b24e6588d12a139ccda22e"
format_stamp: "Formatted at 2026-08-08 08:33:41 on dist-test-slave-chsk"
server_key: "bf5438358c3b00457198a58ca520251b"
server_key_iv: "63341924e4aae2f462fcf06cd2a00355"
server_key_version: "encryptionkey@0"
I20260808 08:33:41.943737 8022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:41.958187 8022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:41.962738 8022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:41.963019 8022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:41.965766 8022 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:41.965914 8022 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:41.966056 8022 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:41.966154 8022 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:33:41 dist-test-slave-chsk krb5kdc[7593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178021, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:41.990325 7895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:41.966644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:48739 (local address 127.5.164.254:44357)
0808 08:33:41.966851 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:41.966858 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:41.968447 (+ 1589us) server_negotiation.cc:407] Connection header received
0808 08:33:41.970632 (+ 2185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:41.970638 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:41.970738 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:41.970857 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:41.973404 (+ 2547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:41.974805 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:41.977253 (+ 2448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:41.977916 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:41.978080 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:41.983671 (+ 5591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:41.983677 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:41.983680 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:41.983716 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:41.986550 (+ 2834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:41.987539 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:41.987544 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:41.987546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:41.987750 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:41.988261 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:41.988267 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:41.988270 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:41.988574 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:41.988733 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:41.989694 (+ 961us) server_negotiation.cc:299] Negotiation successful
0808 08:33:41.989928 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 08:33:41.991739 8047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:41.967293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:44357 (local address 127.5.164.195:48739)
0808 08:33:41.968230 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:41.968287 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:41.970267 (+ 1980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:41.971137 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:41.971149 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:41.972033 (+ 884us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:41.973127 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:41.973161 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:41.975027 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:41.975034 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:41.977089 (+ 2055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:41.977101 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:41.978332 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:41.978342 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:41.978735 (+ 393us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:41.979736 (+ 1001us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:41.979782 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:41.983394 (+ 3612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:41.986739 (+ 3345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:41.986749 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:41.986771 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:41.987380 (+ 609us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:41.987912 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:41.987918 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:41.987924 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:41.988128 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:41.988717 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:41.988725 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:41.989196 (+ 471us) client_negotiation.cc:769] Sending connection context
0808 08:33:41.989580 (+ 384us) client_negotiation.cc:240] Negotiation successful
0808 08:33:41.990191 (+ 611us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"thread_start_us":414,"threads_started":1}
I20260808 08:33:42.014480 8111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:41.997925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:44357 (local address 127.5.164.195:50299)
0808 08:33:41.998662 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:41.998687 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:41.998873 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:41.999261 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:41.999268 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:42.000040 (+ 772us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:42.000536 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.000554 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.001662 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.001670 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.003827 (+ 2157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.003850 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.004927 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.004932 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.005161 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.005927 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:42.005956 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:42.006687 (+ 731us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:42.011203 (+ 4516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:42.011209 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:42.011213 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:42.011869 (+ 656us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:42.012406 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:42.012411 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:42.012421 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:42.012614 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:42.013283 (+ 669us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:42.013286 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:42.013453 (+ 167us) client_negotiation.cc:769] Sending connection context
0808 08:33:42.013648 (+ 195us) client_negotiation.cc:240] Negotiation successful
0808 08:33:42.013963 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":378,"threads_started":1}
I20260808 08:33:42.014601 7895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:41.998217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:50299 (local address 127.5.164.254:44357)
0808 08:33:41.998401 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:41.998407 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:41.998793 (+ 386us) server_negotiation.cc:407] Connection header received
0808 08:33:41.998999 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:41.999002 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:41.999073 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:41.999207 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:42.000767 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.001506 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.004006 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.004568 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.004704 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.006926 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:42.006937 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:42.006944 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:42.007001 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:42.011036 (+ 4035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:42.012076 (+ 1040us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:42.012084 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:42.012090 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:42.012280 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:42.012773 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:42.012778 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:42.012781 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:42.013149 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:42.013334 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.013792 (+ 458us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.014093 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:33:42.023176 8022 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:38877
I20260808 08:33:42.023231 8168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:38877 every 8 connection(s)
I20260808 08:33:42.024374 8022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:33:42.026353 8169 heartbeater.cc:347] Connected to a master server at 127.5.164.254:44357
I20260808 08:33:42.026603 8169 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:42.027316 8169 heartbeater.cc:511] Master 127.5.164.254:44357 requested a full tablet report, sending...
I20260808 08:33:42.028667 7642 ts_manager.cc:194] Registered new tserver with Master: d46f4e0b42b24e6588d12a139ccda22e (127.5.164.195:38877)
I20260808 08:33:42.029438 7642 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:48739
I20260808 08:33:42.034338 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 8022
I20260808 08:33:42.034525 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:33:42.035054 5779 external_mini_cluster.cc:1428] Setting key 957e121fa6112a6f5bb28fa68f0a0f31
I20260808 08:33:42.038089 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:33:42 dist-test-slave-chsk krb5kdc[7593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:33:42 dist-test-slave-chsk krb5kdc[7593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:42.093238 7895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.077512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54000 (local address 127.5.164.254:44357)
0808 08:33:42.077726 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.077730 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.078098 (+ 368us) server_negotiation.cc:407] Connection header received
0808 08:33:42.078258 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.078262 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.078331 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.078429 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:42.080062 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.080852 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.082443 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.082898 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.083005 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.087582 (+ 4577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:42.087588 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:42.087592 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:42.087659 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:42.090504 (+ 2845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:42.091300 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:42.091310 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:42.091312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:42.091457 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:42.091873 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:42.091877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:42.091879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:42.092181 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:42.092412 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.092701 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.092883 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:33:42.098078 7642 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54000:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:33:42.105237 7642 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:33:42.143010 8184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.117885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60946 (local address 127.5.164.194:36651)
0808 08:33:42.129904 (+ 12019us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.129917 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.132236 (+ 2319us) server_negotiation.cc:407] Connection header received
0808 08:33:42.132403 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.132414 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.132731 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.132974 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:42.134055 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.135712 (+ 1657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.139515 (+ 3803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.141193 (+ 1678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.141340 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.141586 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.142436 (+ 850us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.142626 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11822,"thread_start_us":11662,"threads_started":1}
I20260808 08:33:42.143774 8187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.118747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45786 (local address 127.5.164.193:45707)
0808 08:33:42.128348 (+ 9601us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.128364 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.132241 (+ 3877us) server_negotiation.cc:407] Connection header received
0808 08:33:42.132388 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.132400 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.132732 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.132969 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:42.135451 (+ 2482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.137294 (+ 1843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.140639 (+ 3345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.142145 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.142301 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.142504 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.143298 (+ 794us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.143470 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9377,"thread_start_us":9213,"threads_started":1}
I20260808 08:33:42.144109 8186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.117837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:36651 (local address 127.0.0.1:60946)
0808 08:33:42.130806 (+ 12969us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.131628 (+ 822us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:42.131945 (+ 317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:42.133288 (+ 1343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:42.133296 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:42.133329 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:42.133795 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.133812 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.135878 (+ 2066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.135883 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.139279 (+ 3396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.139298 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.141721 (+ 2423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.141729 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.142033 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.142102 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 08:33:42.142254 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 08:33:42.143548 (+ 1294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12613,"mutex_wait_us":1024,"thread_start_us":13512,"threads_started":1}
I20260808 08:33:42.144747 8182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.118350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:45707 (local address 127.0.0.1:45786)
0808 08:33:42.131729 (+ 13379us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.131756 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:42.131949 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:42.134726 (+ 2777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:42.134732 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:42.134764 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:42.135207 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.135227 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.138080 (+ 2853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.138084 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.140394 (+ 2310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.140409 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.142655 (+ 2246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.142662 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.142835 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.142867 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 08:33:42.142961 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 08:33:42.143127 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13199,"mutex_wait_us":1,"thread_start_us":14780,"threads_started":1}
I20260808 08:33:42.148741 7941 tablet_service.cc:1467] Processing CreateTablet for tablet d5737ec6d5264b918839f2eb89b06a4c (DEFAULT_TABLE table=test-table [id=483bd1e08f7b4a809498f5a60287aabf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:42.150188 8188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.119312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53710 (local address 127.5.164.195:38877)
0808 08:33:42.135067 (+ 15755us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.135076 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.135112 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:33:42.135233 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.135241 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.135477 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.135680 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:42.138319 (+ 2639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.140428 (+ 2109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.144318 (+ 3890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.148615 (+ 4297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.148778 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.149031 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.149660 (+ 629us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.149842 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15569,"thread_start_us":16784,"threads_started":1}
I20260808 08:33:42.150246 8185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.118350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:38877 (local address 127.0.0.1:53710)
0808 08:33:42.133419 (+ 15069us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.133445 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:42.133576 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:42.136008 (+ 2432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:42.136013 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:42.136036 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:42.137744 (+ 1708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.137759 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.141860 (+ 4101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.141868 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.144070 (+ 2202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.144088 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.149225 (+ 5137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.149234 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.149463 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.149502 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 08:33:42.149605 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 08:33:42.149775 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14937,"mutex_wait_us":20,"thread_start_us":11859,"threads_started":1}
I20260808 08:33:42.150673 7941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5737ec6d5264b918839f2eb89b06a4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:42.151010 7796 tablet_service.cc:1467] Processing CreateTablet for tablet d5737ec6d5264b918839f2eb89b06a4c (DEFAULT_TABLE table=test-table [id=483bd1e08f7b4a809498f5a60287aabf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:42.152644 7796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5737ec6d5264b918839f2eb89b06a4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:42.154098 8091 tablet_service.cc:1467] Processing CreateTablet for tablet d5737ec6d5264b918839f2eb89b06a4c (DEFAULT_TABLE table=test-table [id=483bd1e08f7b4a809498f5a60287aabf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:42.155603 8091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5737ec6d5264b918839f2eb89b06a4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:42.166322 8189 tablet_bootstrap.cc:492] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175: Bootstrap starting.
I20260808 08:33:42.168395 8190 tablet_bootstrap.cc:492] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193: Bootstrap starting.
I20260808 08:33:42.172243 8189 tablet_bootstrap.cc:654] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:42.172518 8190 tablet_bootstrap.cc:654] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:42.174064 8189 log.cc:824] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:42.174170 8190 log.cc:824] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:42.181912 8191 tablet_bootstrap.cc:492] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e: Bootstrap starting.
I20260808 08:33:42.186589 8190 tablet_bootstrap.cc:492] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193: No bootstrap required, opened a new log
I20260808 08:33:42.186589 8189 tablet_bootstrap.cc:492] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175: No bootstrap required, opened a new log
I20260808 08:33:42.186604 8191 tablet_bootstrap.cc:654] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:42.186911 8190 ts_tablet_manager.cc:1397] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.007s
I20260808 08:33:42.186911 8189 ts_tablet_manager.cc:1397] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175: Time spent bootstrapping tablet: real 0.021s user 0.012s sys 0.004s
I20260808 08:33:42.188165 8191 log.cc:824] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:42.199314 8191 tablet_bootstrap.cc:492] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e: No bootstrap required, opened a new log
I20260808 08:33:42.199805 8191 ts_tablet_manager.cc:1397] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.007s
I20260808 08:33:42.199872 8190 raft_consensus.cc:348] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } }
I20260808 08:33:42.199786 8189 raft_consensus.cc:348] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } }
I20260808 08:33:42.200306 8190 raft_consensus.cc:374] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:42.200310 8189 raft_consensus.cc:374] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:42.200418 8190 raft_consensus.cc:729] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73b3fac3ffe14eec84694e3d145be193, State: Initialized, Role: FOLLOWER
I20260808 08:33:42.200418 8189 raft_consensus.cc:729] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b21088cfc70f4d2ba436fbb63d67c175, State: Initialized, Role: FOLLOWER
I20260808 08:33:42.201115 8189 consensus_queue.cc:260] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } }
I20260808 08:33:42.201212 8190 consensus_queue.cc:260] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } }
I20260808 08:33:42.202625 8018 heartbeater.cc:503] Master 127.5.164.254:44357 was elected leader, sending a full tablet report...
I20260808 08:33:42.203081 8189 ts_tablet_manager.cc:1428] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175: Time spent starting tablet: real 0.016s user 0.012s sys 0.004s
I20260808 08:33:42.204707 8190 ts_tablet_manager.cc:1428] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193: Time spent starting tablet: real 0.018s user 0.007s sys 0.007s
I20260808 08:33:42.211979 8191 raft_consensus.cc:348] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } }
I20260808 08:33:42.212388 8191 raft_consensus.cc:374] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:42.212514 8191 raft_consensus.cc:729] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d46f4e0b42b24e6588d12a139ccda22e, State: Initialized, Role: FOLLOWER
I20260808 08:33:42.213201 8191 consensus_queue.cc:260] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } }
I20260808 08:33:42.214329 8169 heartbeater.cc:503] Master 127.5.164.254:44357 was elected leader, sending a full tablet report...
I20260808 08:33:42.215034 8191 ts_tablet_manager.cc:1428] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e: Time spent starting tablet: real 0.015s user 0.013s sys 0.001s
W20260808 08:33:42.246775 8019 tablet.cc:2369] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:33:42.276015 8170 tablet.cc:2369] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:33:42.306777 8196 raft_consensus.cc:482] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:42.307122 8196 raft_consensus.cc:504] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } }
I20260808 08:33:42.308859 8196 leader_election.cc:288] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d46f4e0b42b24e6588d12a139ccda22e (127.5.164.195:38877), 73b3fac3ffe14eec84694e3d145be193 (127.5.164.193:45707)
I20260808 08:33:42.318365 8187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.309498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:46863 (local address 127.5.164.193:45707)
0808 08:33:42.309797 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.309803 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.310269 (+ 466us) server_negotiation.cc:407] Connection header received
0808 08:33:42.310534 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.310540 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.310621 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.310731 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:42.311722 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.312845 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.315897 (+ 3052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.317135 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.317313 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.317391 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.317953 (+ 562us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.318093 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260808 08:33:42.318361 8188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.309388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:42707 (local address 127.5.164.195:38877)
0808 08:33:42.309613 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.309622 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.310445 (+ 823us) server_negotiation.cc:407] Connection header received
0808 08:33:42.310577 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.310582 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.310655 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.310784 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:42.311729 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.312845 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.315897 (+ 3052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.317135 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.317320 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.317392 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.317953 (+ 561us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.318093 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 08:33:42.318574 8199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.309191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:45707 (local address 127.5.164.194:46863)
0808 08:33:42.310120 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.310153 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:42.310332 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:42.310791 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:42.310796 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:42.310828 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:42.311575 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.311587 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.313007 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.313013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.315720 (+ 2707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.315735 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.317437 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.317444 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.317736 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.317798 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 08:33:42.317901 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 08:33:42.318098 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"mutex_wait_us":308,"thread_start_us":484,"threads_started":1}
I20260808 08:33:42.318962 8200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.309277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:38877 (local address 127.5.164.194:42707)
0808 08:33:42.310310 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.310332 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:42.310445 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:42.310806 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:42.310810 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:42.310897 (+ 87us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:42.311508 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.311530 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.313010 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.313014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.315719 (+ 2705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.315735 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.317448 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.317452 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.317741 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.317794 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 08:33:42.317901 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 08:33:42.318098 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":909,"mutex_wait_us":286,"spinlock_wait_cycles":22400,"thread_start_us":699,"threads_started":1}
I20260808 08:33:42.319667 7817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5737ec6d5264b918839f2eb89b06a4c" candidate_uuid: "b21088cfc70f4d2ba436fbb63d67c175" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73b3fac3ffe14eec84694e3d145be193" is_pre_election: true
I20260808 08:33:42.319869 8118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5737ec6d5264b918839f2eb89b06a4c" candidate_uuid: "b21088cfc70f4d2ba436fbb63d67c175" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d46f4e0b42b24e6588d12a139ccda22e" is_pre_election: true
I20260808 08:33:42.320217 7817 raft_consensus.cc:2454] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b21088cfc70f4d2ba436fbb63d67c175 in term 0.
I20260808 08:33:42.320412 8118 raft_consensus.cc:2454] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b21088cfc70f4d2ba436fbb63d67c175 in term 0.
I20260808 08:33:42.320987 7889 leader_election.cc:302] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73b3fac3ffe14eec84694e3d145be193, b21088cfc70f4d2ba436fbb63d67c175; no voters:
I20260808 08:33:42.321405 8196 raft_consensus.cc:2781] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:42.321558 8196 raft_consensus.cc:482] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:42.321679 8196 raft_consensus.cc:3037] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:42.324004 8196 raft_consensus.cc:504] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } }
I20260808 08:33:42.324724 8196 leader_election.cc:288] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [CANDIDATE]: Term 1 election: Requested vote from peers d46f4e0b42b24e6588d12a139ccda22e (127.5.164.195:38877), 73b3fac3ffe14eec84694e3d145be193 (127.5.164.193:45707)
I20260808 08:33:42.325133 8118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5737ec6d5264b918839f2eb89b06a4c" candidate_uuid: "b21088cfc70f4d2ba436fbb63d67c175" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d46f4e0b42b24e6588d12a139ccda22e"
I20260808 08:33:42.325273 7817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5737ec6d5264b918839f2eb89b06a4c" candidate_uuid: "b21088cfc70f4d2ba436fbb63d67c175" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73b3fac3ffe14eec84694e3d145be193"
I20260808 08:33:42.325361 8118 raft_consensus.cc:3037] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:42.325498 7817 raft_consensus.cc:3037] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:42.328802 8118 raft_consensus.cc:2454] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b21088cfc70f4d2ba436fbb63d67c175 in term 1.
I20260808 08:33:42.328800 7817 raft_consensus.cc:2454] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b21088cfc70f4d2ba436fbb63d67c175 in term 1.
I20260808 08:33:42.329312 7889 leader_election.cc:302] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 73b3fac3ffe14eec84694e3d145be193, b21088cfc70f4d2ba436fbb63d67c175, d46f4e0b42b24e6588d12a139ccda22e; no voters:
I20260808 08:33:42.329715 8196 raft_consensus.cc:2781] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:42.330283 8196 raft_consensus.cc:686] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [term 1 LEADER]: Becoming Leader. State: Replica: b21088cfc70f4d2ba436fbb63d67c175, State: Running, Role: LEADER
I20260808 08:33:42.330801 8196 consensus_queue.cc:237] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } }
I20260808 08:33:42.336131 7642 catalog_manager.cc:5495] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 reported cstate change: term changed from 0 to 1, leader changed from <none> to b21088cfc70f4d2ba436fbb63d67c175 (127.5.164.194). New cstate: current_term: 1 leader_uuid: "b21088cfc70f4d2ba436fbb63d67c175" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } health_report { overall_health: UNKNOWN } } }
Aug 08 08:33:42 dist-test-slave-chsk krb5kdc[7593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178020, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:42.427066 7895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.413729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54008 (local address 127.5.164.254:44357)
0808 08:33:42.413974 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.413979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.414595 (+ 616us) server_negotiation.cc:407] Connection header received
0808 08:33:42.414754 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.414758 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.414836 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.414936 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:42.416096 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.416809 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.418011 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.418410 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.418504 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.421849 (+ 3345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:42.421856 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:42.421863 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:42.421901 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:42.424642 (+ 2741us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:42.425306 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:42.425310 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:42.425313 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:42.425429 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:42.425758 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:42.425760 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:42.425762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:42.426043 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:42.426175 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.426582 (+ 407us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.426804 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":70}
I20260808 08:33:42.427073 8210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.413730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:44357 (local address 127.0.0.1:54008)
0808 08:33:42.414481 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.414498 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:42.414638 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:42.414989 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:42.414992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:42.415689 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:42.415949 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.415959 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.416924 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.416928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.417870 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.417881 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.418584 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.418588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.418717 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.419420 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:42.419442 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:42.421633 (+ 2191us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:42.424779 (+ 3146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:42.424790 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:42.424796 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:42.425194 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:42.425529 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:42.425532 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:42.425534 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:42.425666 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:42.426157 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:42.426163 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:42.426324 (+ 161us) client_negotiation.cc:769] Sending connection context
0808 08:33:42.426455 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 08:33:42.426691 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":402,"threads_started":1}
W20260808 08:33:42.427462 7867 tablet.cc:2369] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:33:42.432751 7642 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:54008:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 08:33:42.433755 7642 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:33:42.440802 7941 tablet_service.cc:1467] Processing CreateTablet for tablet a0bfc9357bb04151aac5a104987e6cc5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1e5a6b321e774d42bf73fa56b0b745a9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:33:42.440758 7796 tablet_service.cc:1467] Processing CreateTablet for tablet a0bfc9357bb04151aac5a104987e6cc5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1e5a6b321e774d42bf73fa56b0b745a9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:33:42.441131 8091 tablet_service.cc:1467] Processing CreateTablet for tablet a0bfc9357bb04151aac5a104987e6cc5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1e5a6b321e774d42bf73fa56b0b745a9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:33:42.441866 7941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0bfc9357bb04151aac5a104987e6cc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:42.441862 7796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0bfc9357bb04151aac5a104987e6cc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:42.441956 8091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0bfc9357bb04151aac5a104987e6cc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:42.448074 8191 tablet_bootstrap.cc:492] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e: Bootstrap starting.
I20260808 08:33:42.449837 8191 tablet_bootstrap.cc:654] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:42.450902 8190 tablet_bootstrap.cc:492] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193: Bootstrap starting.
I20260808 08:33:42.451431 8189 tablet_bootstrap.cc:492] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175: Bootstrap starting.
I20260808 08:33:42.452550 8190 tablet_bootstrap.cc:654] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:42.453226 8189 tablet_bootstrap.cc:654] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:42.455544 8191 tablet_bootstrap.cc:492] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e: No bootstrap required, opened a new log
I20260808 08:33:42.455716 8191 ts_tablet_manager.cc:1397] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260808 08:33:42.456604 8191 raft_consensus.cc:348] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.456913 8191 raft_consensus.cc:374] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:42.457028 8191 raft_consensus.cc:729] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d46f4e0b42b24e6588d12a139ccda22e, State: Initialized, Role: FOLLOWER
I20260808 08:33:42.457974 8189 tablet_bootstrap.cc:492] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175: No bootstrap required, opened a new log
I20260808 08:33:42.458133 8189 ts_tablet_manager.cc:1397] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260808 08:33:42.458843 8189 raft_consensus.cc:348] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.459096 8189 raft_consensus.cc:374] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:42.459242 8189 raft_consensus.cc:729] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b21088cfc70f4d2ba436fbb63d67c175, State: Initialized, Role: FOLLOWER
I20260808 08:33:42.459497 8189 consensus_queue.cc:260] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.460127 8189 ts_tablet_manager.cc:1428] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 08:33:42.459992 8196 tablet_replica.cc:439] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } }
I20260808 08:33:42.460404 8196 tablet_replica.cc:442] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:33:42.460342 8191 consensus_queue.cc:260] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.460970 8191 ts_tablet_manager.cc:1428] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260808 08:33:42.460906 8198 tablet_replica.cc:439] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } }
I20260808 08:33:42.461340 8198 tablet_replica.cc:442] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:33:42.463506 8190 tablet_bootstrap.cc:492] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193: No bootstrap required, opened a new log
I20260808 08:33:42.463688 8190 ts_tablet_manager.cc:1397] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.004s
I20260808 08:33:42.464564 8190 raft_consensus.cc:348] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.464844 8190 raft_consensus.cc:374] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:42.464954 8190 raft_consensus.cc:729] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73b3fac3ffe14eec84694e3d145be193, State: Initialized, Role: FOLLOWER
I20260808 08:33:42.465188 8190 consensus_queue.cc:260] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.465801 8190 ts_tablet_manager.cc:1428] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260808 08:33:42.465659 8197 tablet_replica.cc:439] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } }
I20260808 08:33:42.466079 8197 tablet_replica.cc:442] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:33:42.504263 8198 raft_consensus.cc:482] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:42.504491 8198 raft_consensus.cc:504] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.506152 8198 leader_election.cc:288] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73b3fac3ffe14eec84694e3d145be193 (127.5.164.193:45707), b21088cfc70f4d2ba436fbb63d67c175 (127.5.164.194:36651)
I20260808 08:33:42.512778 8214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.506508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:36651 (local address 127.5.164.195:39899)
0808 08:33:42.507357 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.507371 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:42.507471 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:42.507790 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:42.507794 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:42.507817 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:42.508152 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.508163 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.509209 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.509216 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.510693 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.510705 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.511886 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.511892 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.512062 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.512085 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:33:42.512197 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 08:33:42.512331 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":733,"mutex_wait_us":1,"thread_start_us":431,"threads_started":1}
I20260808 08:33:42.512807 8187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.506464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:51553 (local address 127.5.164.193:45707)
0808 08:33:42.506760 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.506769 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.507346 (+ 577us) server_negotiation.cc:407] Connection header received
0808 08:33:42.507586 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.507590 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.507650 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.507755 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:42.508394 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.509128 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.510900 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.511780 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.511966 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.512044 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.512389 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.512526 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260808 08:33:42.513033 8184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.506519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:39899 (local address 127.5.164.194:36651)
0808 08:33:42.506854 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.506865 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.507452 (+ 587us) server_negotiation.cc:407] Connection header received
0808 08:33:42.507616 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.507620 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.507677 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.507775 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:42.508336 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.509063 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.510852 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.511695 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.511886 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.511961 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.512234 (+ 273us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.512360 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260808 08:33:42.513602 8215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.506364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:45707 (local address 127.5.164.195:51553)
0808 08:33:42.507243 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.507260 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:42.507444 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:42.507772 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:42.507776 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:42.507799 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:42.508242 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.508251 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.509258 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.509269 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.510750 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.510762 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.512012 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.512018 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.512170 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.512191 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 08:33:42.513052 (+ 861us) client_negotiation.cc:240] Negotiation successful
0808 08:33:42.513176 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"mutex_wait_us":49,"thread_start_us":704,"threads_started":1}
I20260808 08:33:42.514295 7817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0bfc9357bb04151aac5a104987e6cc5" candidate_uuid: "d46f4e0b42b24e6588d12a139ccda22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73b3fac3ffe14eec84694e3d145be193" is_pre_election: true
I20260808 08:33:42.514214 7967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0bfc9357bb04151aac5a104987e6cc5" candidate_uuid: "d46f4e0b42b24e6588d12a139ccda22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b21088cfc70f4d2ba436fbb63d67c175" is_pre_election: true
I20260808 08:33:42.514561 7817 raft_consensus.cc:2454] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d46f4e0b42b24e6588d12a139ccda22e in term 0.
I20260808 08:33:42.514633 7967 raft_consensus.cc:2454] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d46f4e0b42b24e6588d12a139ccda22e in term 0.
I20260808 08:33:42.515120 8041 leader_election.cc:302] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73b3fac3ffe14eec84694e3d145be193, d46f4e0b42b24e6588d12a139ccda22e; no voters:
I20260808 08:33:42.515564 8198 raft_consensus.cc:2781] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:42.515691 8198 raft_consensus.cc:482] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:42.515801 8198 raft_consensus.cc:3037] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:42.517871 8198 raft_consensus.cc:504] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.518399 8198 leader_election.cc:288] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [CANDIDATE]: Term 1 election: Requested vote from peers 73b3fac3ffe14eec84694e3d145be193 (127.5.164.193:45707), b21088cfc70f4d2ba436fbb63d67c175 (127.5.164.194:36651)
I20260808 08:33:42.518929 7967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0bfc9357bb04151aac5a104987e6cc5" candidate_uuid: "d46f4e0b42b24e6588d12a139ccda22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b21088cfc70f4d2ba436fbb63d67c175"
I20260808 08:33:42.518911 7817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0bfc9357bb04151aac5a104987e6cc5" candidate_uuid: "d46f4e0b42b24e6588d12a139ccda22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73b3fac3ffe14eec84694e3d145be193"
I20260808 08:33:42.519130 7967 raft_consensus.cc:3037] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:42.519178 7817 raft_consensus.cc:3037] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:42.522398 7817 raft_consensus.cc:2454] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d46f4e0b42b24e6588d12a139ccda22e in term 1.
I20260808 08:33:42.522429 7967 raft_consensus.cc:2454] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d46f4e0b42b24e6588d12a139ccda22e in term 1.
I20260808 08:33:42.522856 8041 leader_election.cc:302] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 73b3fac3ffe14eec84694e3d145be193, b21088cfc70f4d2ba436fbb63d67c175, d46f4e0b42b24e6588d12a139ccda22e; no voters:
I20260808 08:33:42.523185 8198 raft_consensus.cc:2781] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:42.523582 8198 raft_consensus.cc:686] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [term 1 LEADER]: Becoming Leader. State: Replica: d46f4e0b42b24e6588d12a139ccda22e, State: Running, Role: LEADER
I20260808 08:33:42.524109 8198 consensus_queue.cc:237] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.527400 8216 tablet_replica.cc:439] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e: TxnStatusTablet state changed. Reason: New leader d46f4e0b42b24e6588d12a139ccda22e. Latest consensus state: current_term: 1 leader_uuid: "d46f4e0b42b24e6588d12a139ccda22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } }
I20260808 08:33:42.527720 8216 tablet_replica.cc:442] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:33:42.528637 8218 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 08:33:42.528911 8218 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 08:33:42.529367 7644 catalog_manager.cc:5495] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e reported cstate change: term changed from 0 to 1, leader changed from <none> to d46f4e0b42b24e6588d12a139ccda22e (127.5.164.195). New cstate: current_term: 1 leader_uuid: "d46f4e0b42b24e6588d12a139ccda22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } health_report { overall_health: HEALTHY } } }
I20260808 08:33:42.563231 8188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.557297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53726 (local address 127.5.164.195:38877)
0808 08:33:42.557548 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.557555 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.557682 (+ 127us) server_negotiation.cc:407] Connection header received
0808 08:33:42.557973 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.557977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.558122 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.558276 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:42.558648 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.559527 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.560935 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.561369 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.561532 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.561978 (+ 446us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:42.562482 (+ 504us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:42.562650 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.562772 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.562849 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260808 08:33:42.563232 8210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.557289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:38877 (local address 127.0.0.1:53726)
0808 08:33:42.557573 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.557594 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:42.557767 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:42.558297 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:42.558302 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:42.558315 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:33:42.558505 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.558513 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.559663 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.559669 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.560811 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.560825 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.561566 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.561572 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.561737 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.561787 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:33:42.562611 (+ 824us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:33:42.562643 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 08:33:42.562749 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 08:33:42.562895 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 08:33:42.570619 7817 raft_consensus.cc:1261] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Refusing update from remote peer d46f4e0b42b24e6588d12a139ccda22e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:42.570614 7967 raft_consensus.cc:1261] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Refusing update from remote peer d46f4e0b42b24e6588d12a139ccda22e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:42.571619 8216 consensus_queue.cc:1035] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:42.571991 8198 consensus_queue.cc:1035] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:42.582123 8196 tablet_replica.cc:439] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175: TxnStatusTablet state changed. Reason: New leader d46f4e0b42b24e6588d12a139ccda22e. Latest consensus state: current_term: 1 leader_uuid: "d46f4e0b42b24e6588d12a139ccda22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } }
I20260808 08:33:42.582471 8196 tablet_replica.cc:442] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:33:42.584120 8197 tablet_replica.cc:439] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193: TxnStatusTablet state changed. Reason: New leader d46f4e0b42b24e6588d12a139ccda22e. Latest consensus state: current_term: 1 leader_uuid: "d46f4e0b42b24e6588d12a139ccda22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } }
I20260808 08:33:42.584408 8197 tablet_replica.cc:442] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:33:42.585779 8221 mvcc.cc:205] Tried to move back new op lower bound from 7316185180439080960 to 7316185180262326272. Current Snapshot: MvccSnapshot[applied={T|T < 7316185180439080960}]
I20260808 08:33:42.595036 8196 tablet_replica.cc:439] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d46f4e0b42b24e6588d12a139ccda22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } }
I20260808 08:33:42.596251 8196 tablet_replica.cc:442] T a0bfc9357bb04151aac5a104987e6cc5 P b21088cfc70f4d2ba436fbb63d67c175: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:33:42.594641 8198 tablet_replica.cc:439] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d46f4e0b42b24e6588d12a139ccda22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } }
I20260808 08:33:42.597999 8198 tablet_replica.cc:442] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:33:42.600505 8197 tablet_replica.cc:439] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d46f4e0b42b24e6588d12a139ccda22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } }
I20260808 08:33:42.600835 8197 tablet_replica.cc:442] T a0bfc9357bb04151aac5a104987e6cc5 P 73b3fac3ffe14eec84694e3d145be193: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:33:42.603088 8216 tablet_replica.cc:439] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d46f4e0b42b24e6588d12a139ccda22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } } }
I20260808 08:33:42.603457 8216 tablet_replica.cc:442] T a0bfc9357bb04151aac5a104987e6cc5 P d46f4e0b42b24e6588d12a139ccda22e: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:33:42.615347 8184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.608946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60962 (local address 127.5.164.194:36651)
0808 08:33:42.609137 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.609143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.609616 (+ 473us) server_negotiation.cc:407] Connection header received
0808 08:33:42.609814 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.609820 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.609922 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.610068 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:42.610452 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.611615 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.612931 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.613547 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.613672 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.614035 (+ 363us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:42.614688 (+ 653us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:42.614847 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.614907 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.614998 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:33:42.632555 8188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.626623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:42869 (local address 127.5.164.195:38877)
0808 08:33:42.626815 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.626837 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.627409 (+ 572us) server_negotiation.cc:407] Connection header received
0808 08:33:42.627621 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.627627 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.627707 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.627805 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:42.628300 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.629044 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.630586 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.631199 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.631359 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.631790 (+ 431us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:42.631898 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:42.632005 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.632158 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.632239 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 08:33:42.632650 8236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.626631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:38877 (local address 127.5.164.194:42869)
0808 08:33:42.627307 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.627322 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:42.627472 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:42.627819 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:42.627824 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:42.627836 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:33:42.628152 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.628160 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.629197 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.629203 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.630446 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.630459 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.631387 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.631393 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.631528 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.631587 (+ 59us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:33:42.632008 (+ 421us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:33:42.632029 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 08:33:42.632133 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 08:33:42.632262 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":341,"threads_started":1}
I20260808 08:33:42.642243 7817 raft_consensus.cc:1261] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Refusing update from remote peer b21088cfc70f4d2ba436fbb63d67c175: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:42.642563 8118 raft_consensus.cc:1261] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e [term 1 FOLLOWER]: Refusing update from remote peer b21088cfc70f4d2ba436fbb63d67c175: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:42.642854 8201 consensus_queue.cc:1035] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:42.643363 8196 consensus_queue.cc:1035] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:42.648806 8223 mvcc.cc:205] Tried to move back new op lower bound from 7316185180736622592 to 7316185179471613952. Current Snapshot: MvccSnapshot[applied={T|T < 7316185180736622592}]
I20260808 08:33:42.678799 8242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.671667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:36651 (local address 127.5.164.195:46235)
0808 08:33:42.672416 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.672433 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:42.672556 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:42.672887 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:42.672890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:42.672899 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:33:42.673234 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.673241 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.674641 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.674646 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.676206 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.676218 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.677222 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.677228 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.677412 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.677475 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:33:42.677934 (+ 459us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:33:42.677945 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 08:33:42.678203 (+ 258us) client_negotiation.cc:240] Negotiation successful
0808 08:33:42.678340 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":385,"threads_started":1}
I20260808 08:33:42.679237 8184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.672111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:46235 (local address 127.5.164.194:36651)
0808 08:33:42.672302 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.672309 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.672514 (+ 205us) server_negotiation.cc:407] Connection header received
0808 08:33:42.672674 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.672679 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.672774 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.672867 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:42.673401 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.674464 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.676346 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.677018 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.677143 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.677678 (+ 535us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:42.677813 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:42.677904 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.678079 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.678162 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:33:42.718298 7641 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:42.718605 7641 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:42.722571 7641 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c: Sending DeleteTablet for 3 replicas of tablet d5737ec6d5264b918839f2eb89b06a4c
I20260808 08:33:42.723678 7941 tablet_service.cc:1514] Processing DeleteTablet for tablet d5737ec6d5264b918839f2eb89b06a4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:42 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:60946
I20260808 08:33:42.723801 8091 tablet_service.cc:1514] Processing DeleteTablet for tablet d5737ec6d5264b918839f2eb89b06a4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:42 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:53710
I20260808 08:33:42.725363 7796 tablet_service.cc:1514] Processing DeleteTablet for tablet d5737ec6d5264b918839f2eb89b06a4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:42 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:45786
I20260808 08:33:42.732667 7641 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54000:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:33:42.733361 7641 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:33:42.740851 7794 tablet_service.cc:1467] Processing CreateTablet for tablet 69d08d2484fd4b728ccdf37e445bce40 (DEFAULT_TABLE table=test-table [id=19d68c0ed60f4b76a978908d052161a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:42.741184 7939 tablet_service.cc:1467] Processing CreateTablet for tablet 69d08d2484fd4b728ccdf37e445bce40 (DEFAULT_TABLE table=test-table [id=19d68c0ed60f4b76a978908d052161a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:42.741472 7794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69d08d2484fd4b728ccdf37e445bce40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:42.741889 7939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69d08d2484fd4b728ccdf37e445bce40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:42.743746 8245 tablet_replica.cc:330] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175: stopping tablet replica
I20260808 08:33:42.744379 8245 raft_consensus.cc:2229] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:33:42.745116 8245 raft_consensus.cc:2258] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:42.747319 8245 ts_tablet_manager.cc:1905] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:42.747713 8090 tablet_service.cc:1467] Processing CreateTablet for tablet 69d08d2484fd4b728ccdf37e445bce40 (DEFAULT_TABLE table=test-table [id=19d68c0ed60f4b76a978908d052161a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:42.748333 8090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69d08d2484fd4b728ccdf37e445bce40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:42.748809 8189 tablet_bootstrap.cc:492] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175: Bootstrap starting.
I20260808 08:33:42.750588 8189 tablet_bootstrap.cc:654] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:42.756341 8245 ts_tablet_manager.cc:1918] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:33:42.756556 8245 log.cc:1196] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/d5737ec6d5264b918839f2eb89b06a4c
I20260808 08:33:42.757478 8245 ts_tablet_manager.cc:1939] T d5737ec6d5264b918839f2eb89b06a4c P b21088cfc70f4d2ba436fbb63d67c175: Deleting consensus metadata
I20260808 08:33:42.758036 8191 tablet_bootstrap.cc:492] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e: Bootstrap starting.
I20260808 08:33:42.759459 7626 catalog_manager.cc:4841] TS b21088cfc70f4d2ba436fbb63d67c175 (127.5.164.194:36651): tablet d5737ec6d5264b918839f2eb89b06a4c (table test-table [id=483bd1e08f7b4a809498f5a60287aabf]) successfully deleted
I20260808 08:33:42.760229 8191 tablet_bootstrap.cc:654] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:42.761089 8247 tablet_replica.cc:330] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193: stopping tablet replica
I20260808 08:33:42.761654 8247 raft_consensus.cc:2229] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:42.762121 8247 raft_consensus.cc:2258] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:42.763588 8190 tablet_bootstrap.cc:492] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193: Bootstrap starting.
I20260808 08:33:42.764437 8189 tablet_bootstrap.cc:492] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175: No bootstrap required, opened a new log
I20260808 08:33:42.764616 8189 ts_tablet_manager.cc:1397] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.000s
I20260808 08:33:42.765065 8247 ts_tablet_manager.cc:1905] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:42.765331 8190 tablet_bootstrap.cc:654] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:42.765415 8189 raft_consensus.cc:348] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.765683 8189 raft_consensus.cc:374] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:42.765770 8189 raft_consensus.cc:729] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b21088cfc70f4d2ba436fbb63d67c175, State: Initialized, Role: FOLLOWER
I20260808 08:33:42.766047 8189 consensus_queue.cc:260] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.766790 8189 ts_tablet_manager.cc:1428] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260808 08:33:42.769549 8246 tablet_replica.cc:330] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e: stopping tablet replica
I20260808 08:33:42.770030 8246 raft_consensus.cc:2229] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:42.770426 8246 raft_consensus.cc:2258] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:42.775321 8191 tablet_bootstrap.cc:492] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e: No bootstrap required, opened a new log
I20260808 08:33:42.775496 8191 ts_tablet_manager.cc:1397] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260808 08:33:42.776328 8191 raft_consensus.cc:348] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.776577 8191 raft_consensus.cc:374] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:42.776667 8191 raft_consensus.cc:729] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d46f4e0b42b24e6588d12a139ccda22e, State: Initialized, Role: FOLLOWER
I20260808 08:33:42.777233 8191 consensus_queue.cc:260] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.777578 8247 ts_tablet_manager.cc:1918] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:33:42.777797 8247 log.cc:1196] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/d5737ec6d5264b918839f2eb89b06a4c
I20260808 08:33:42.779881 8246 ts_tablet_manager.cc:1905] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:42.781900 8191 ts_tablet_manager.cc:1428] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260808 08:33:42.789088 8246 ts_tablet_manager.cc:1918] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:33:42.789294 8246 log.cc:1196] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/d5737ec6d5264b918839f2eb89b06a4c
I20260808 08:33:42.790022 8246 ts_tablet_manager.cc:1939] T d5737ec6d5264b918839f2eb89b06a4c P d46f4e0b42b24e6588d12a139ccda22e: Deleting consensus metadata
I20260808 08:33:42.792245 7625 catalog_manager.cc:4841] TS d46f4e0b42b24e6588d12a139ccda22e (127.5.164.195:38877): tablet d5737ec6d5264b918839f2eb89b06a4c (table test-table [id=483bd1e08f7b4a809498f5a60287aabf]) successfully deleted
I20260808 08:33:42.792647 8247 ts_tablet_manager.cc:1939] T d5737ec6d5264b918839f2eb89b06a4c P 73b3fac3ffe14eec84694e3d145be193: Deleting consensus metadata
I20260808 08:33:42.793994 8190 tablet_bootstrap.cc:492] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193: No bootstrap required, opened a new log
I20260808 08:33:42.794174 8190 ts_tablet_manager.cc:1397] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193: Time spent bootstrapping tablet: real 0.031s user 0.011s sys 0.002s
I20260808 08:33:42.794670 7627 catalog_manager.cc:4841] TS 73b3fac3ffe14eec84694e3d145be193 (127.5.164.193:45707): tablet d5737ec6d5264b918839f2eb89b06a4c (table test-table [id=483bd1e08f7b4a809498f5a60287aabf]) successfully deleted
I20260808 08:33:42.795053 8190 raft_consensus.cc:348] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.795352 8190 raft_consensus.cc:374] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:42.795454 8190 raft_consensus.cc:729] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73b3fac3ffe14eec84694e3d145be193, State: Initialized, Role: FOLLOWER
I20260808 08:33:42.795768 8190 consensus_queue.cc:260] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.796341 8190 ts_tablet_manager.cc:1428] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 08:33:42.861307 8197 raft_consensus.cc:482] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:42.861593 8197 raft_consensus.cc:504] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.863236 8197 leader_election.cc:288] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b21088cfc70f4d2ba436fbb63d67c175 (127.5.164.194:36651), d46f4e0b42b24e6588d12a139ccda22e (127.5.164.195:38877)
I20260808 08:33:42.885109 8188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.864075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:43605 (local address 127.5.164.195:38877)
0808 08:33:42.864285 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.864290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.877515 (+ 13225us) server_negotiation.cc:407] Connection header received
0808 08:33:42.877812 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.877817 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.877907 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.877980 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:42.878756 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.879877 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.882464 (+ 2587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.884003 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.884185 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.884265 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.884629 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.884781 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:33:42.885224 8252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.863482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:36651 (local address 127.5.164.193:41349)
0808 08:33:42.876477 (+ 12995us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.876508 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:42.876696 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:42.877338 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:42.877346 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:42.877378 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:42.877812 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.877825 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.879737 (+ 1912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.879742 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.882269 (+ 2527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.882284 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.884431 (+ 2147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.884436 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.884609 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.884637 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 08:33:42.884712 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 08:33:42.884808 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12771,"mutex_wait_us":43,"thread_start_us":13657,"threads_started":1}
I20260808 08:33:42.885622 8251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.863730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:38877 (local address 127.5.164.193:43605)
0808 08:33:42.877398 (+ 13668us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.877416 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:42.877620 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:42.878195 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:42.878199 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:42.878223 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:33:42.878572 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.878583 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.880057 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.880061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.882269 (+ 2208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.882284 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.884223 (+ 1939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.884229 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.884433 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.884471 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 08:33:42.884571 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 08:33:42.884729 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13529,"mutex_wait_us":58,"thread_start_us":13066,"threads_started":1}
I20260808 08:33:42.885902 8184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.863970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:41349 (local address 127.5.164.194:36651)
0808 08:33:42.864213 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.864220 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.876615 (+ 12395us) server_negotiation.cc:407] Connection header received
0808 08:33:42.876848 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.876854 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.876932 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.877024 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:33:42.878016 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.879315 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.882464 (+ 3149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.884041 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.884240 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.884314 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.885432 (+ 1118us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.885578 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:33:42.886610 8118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69d08d2484fd4b728ccdf37e445bce40" candidate_uuid: "73b3fac3ffe14eec84694e3d145be193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d46f4e0b42b24e6588d12a139ccda22e" is_pre_election: true
I20260808 08:33:42.886670 7967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69d08d2484fd4b728ccdf37e445bce40" candidate_uuid: "73b3fac3ffe14eec84694e3d145be193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b21088cfc70f4d2ba436fbb63d67c175" is_pre_election: true
I20260808 08:33:42.886910 8118 raft_consensus.cc:2454] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73b3fac3ffe14eec84694e3d145be193 in term 0.
I20260808 08:33:42.886960 7967 raft_consensus.cc:2454] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73b3fac3ffe14eec84694e3d145be193 in term 0.
I20260808 08:33:42.887673 7739 leader_election.cc:302] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 73b3fac3ffe14eec84694e3d145be193, b21088cfc70f4d2ba436fbb63d67c175, d46f4e0b42b24e6588d12a139ccda22e; no voters:
I20260808 08:33:42.888134 8197 raft_consensus.cc:2781] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:42.888298 8197 raft_consensus.cc:482] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:42.888392 8197 raft_consensus.cc:3037] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:42.891665 8197 raft_consensus.cc:504] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.892405 8197 leader_election.cc:288] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [CANDIDATE]: Term 1 election: Requested vote from peers b21088cfc70f4d2ba436fbb63d67c175 (127.5.164.194:36651), d46f4e0b42b24e6588d12a139ccda22e (127.5.164.195:38877)
I20260808 08:33:42.893065 7967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69d08d2484fd4b728ccdf37e445bce40" candidate_uuid: "73b3fac3ffe14eec84694e3d145be193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b21088cfc70f4d2ba436fbb63d67c175"
I20260808 08:33:42.893095 8118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69d08d2484fd4b728ccdf37e445bce40" candidate_uuid: "73b3fac3ffe14eec84694e3d145be193" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d46f4e0b42b24e6588d12a139ccda22e"
I20260808 08:33:42.893332 7967 raft_consensus.cc:3037] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:42.893350 8118 raft_consensus.cc:3037] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:42.896838 7967 raft_consensus.cc:2454] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73b3fac3ffe14eec84694e3d145be193 in term 1.
I20260808 08:33:42.896927 8118 raft_consensus.cc:2454] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73b3fac3ffe14eec84694e3d145be193 in term 1.
I20260808 08:33:42.897449 7737 leader_election.cc:302] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73b3fac3ffe14eec84694e3d145be193, d46f4e0b42b24e6588d12a139ccda22e; no voters:
I20260808 08:33:42.897920 8197 raft_consensus.cc:2781] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:42.898438 8197 raft_consensus.cc:686] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [term 1 LEADER]: Becoming Leader. State: Replica: 73b3fac3ffe14eec84694e3d145be193, State: Running, Role: LEADER
I20260808 08:33:42.899195 8197 consensus_queue.cc:237] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:42.903306 7644 catalog_manager.cc:5495] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73b3fac3ffe14eec84694e3d145be193 (127.5.164.193). New cstate: current_term: 1 leader_uuid: "73b3fac3ffe14eec84694e3d145be193" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } health_report { overall_health: UNKNOWN } } }
I20260808 08:33:42.968134 8187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.959630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45798 (local address 127.5.164.193:45707)
0808 08:33:42.959826 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.959833 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.959855 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:33:42.959962 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.959968 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.960111 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.960287 (+ 176us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:42.960934 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.962162 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.964626 (+ 2464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.965318 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.965448 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.966077 (+ 629us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:42.966882 (+ 805us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:42.967032 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.967710 (+ 678us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.967813 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 08:33:42.988827 8188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.980859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:51727 (local address 127.5.164.195:38877)
0808 08:33:42.981042 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:42.981048 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:42.982133 (+ 1085us) server_negotiation.cc:407] Connection header received
0808 08:33:42.982330 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:42.982336 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:42.982424 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:42.982522 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:42.983097 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.984355 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.986488 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.987278 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.987523 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.988008 (+ 485us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:42.988171 (+ 163us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:42.988271 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:42.988440 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 08:33:42.988531 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:33:42.989238 8257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:42.980390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:38877 (local address 127.5.164.193:51727)
0808 08:33:42.982003 (+ 1613us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:42.982023 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:42.982183 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:42.982552 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:42.982557 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:42.982570 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:33:42.982930 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.982944 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.984508 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.984514 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.986252 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:42.986269 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:42.987496 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:42.987504 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:42.987730 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:42.987815 (+ 85us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:33:42.988297 (+ 482us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:33:42.988310 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 08:33:42.988404 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 08:33:42.988569 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1419,"thread_start_us":1202,"threads_started":1}
I20260808 08:33:43.001307 7967 raft_consensus.cc:1261] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Refusing update from remote peer 73b3fac3ffe14eec84694e3d145be193: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:43.001356 8118 raft_consensus.cc:1261] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e [term 1 FOLLOWER]: Refusing update from remote peer 73b3fac3ffe14eec84694e3d145be193: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:43.002123 8197 consensus_queue.cc:1035] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:43.002758 8253 consensus_queue.cc:1035] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:43.008174 8222 mvcc.cc:205] Tried to move back new op lower bound from 7316185182201839616 to 7316185181800120320. Current Snapshot: MvccSnapshot[applied={T|T < 7316185182201839616}]
I20260808 08:33:43.053683 8242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:43.037378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:45707 (local address 127.5.164.195:43897)
0808 08:33:43.037737 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:43.037763 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:43.037874 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:43.038806 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:43.038811 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:43.038824 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:33:43.039008 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:43.039019 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:43.040551 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:43.040556 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:43.042395 (+ 1839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:43.042410 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:43.052269 (+ 9859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:43.052275 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:43.052489 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:43.052558 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:33:43.053091 (+ 533us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:33:43.053102 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 08:33:43.053171 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 08:33:43.053343 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203}
I20260808 08:33:43.056809 8187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:43.038181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:43897 (local address 127.5.164.193:45707)
0808 08:33:43.038365 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:43.038371 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:43.038389 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:33:43.038454 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:43.038460 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:43.038556 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:43.038650 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:43.039180 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:43.040359 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:43.044355 (+ 3996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:43.045050 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:43.045171 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:43.052815 (+ 7644us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:43.052950 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:43.053027 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:43.056408 (+ 3381us) server_negotiation.cc:299] Negotiation successful
0808 08:33:43.056504 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260808 08:33:43.057941 8222 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 08:33:44.672605 7644 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:44.672950 7644 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:44.678941 7644 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c: Sending DeleteTablet for 3 replicas of tablet 69d08d2484fd4b728ccdf37e445bce40
I20260808 08:33:44.679960 7794 tablet_service.cc:1514] Processing DeleteTablet for tablet 69d08d2484fd4b728ccdf37e445bce40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:44 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:45786
I20260808 08:33:44.680106 8091 tablet_service.cc:1514] Processing DeleteTablet for tablet 69d08d2484fd4b728ccdf37e445bce40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:44 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:53710
I20260808 08:33:44.680258 7939 tablet_service.cc:1514] Processing DeleteTablet for tablet 69d08d2484fd4b728ccdf37e445bce40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:44 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:60946
I20260808 08:33:44.693133 8291 tablet_replica.cc:330] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175: stopping tablet replica
I20260808 08:33:44.693217 8288 tablet_replica.cc:330] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193: stopping tablet replica
I20260808 08:33:44.693524 8291 raft_consensus.cc:2229] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:44.693677 8288 raft_consensus.cc:2229] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:33:44.694038 8291 raft_consensus.cc:2258] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:44.694849 8288 raft_consensus.cc:2258] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:44.695789 8291 ts_tablet_manager.cc:1905] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:44.696419 8288 ts_tablet_manager.cc:1905] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:44.696980 8289 tablet_replica.cc:330] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e: stopping tablet replica
I20260808 08:33:44.697331 8289 raft_consensus.cc:2229] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:44.697686 8289 raft_consensus.cc:2258] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:44.698818 8289 ts_tablet_manager.cc:1905] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:44.705660 8288 ts_tablet_manager.cc:1918] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:33:44.705940 8288 log.cc:1196] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/69d08d2484fd4b728ccdf37e445bce40
I20260808 08:33:44.706254 8291 ts_tablet_manager.cc:1918] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:33:44.706506 8291 log.cc:1196] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/69d08d2484fd4b728ccdf37e445bce40
I20260808 08:33:44.707091 8288 ts_tablet_manager.cc:1939] T 69d08d2484fd4b728ccdf37e445bce40 P 73b3fac3ffe14eec84694e3d145be193: Deleting consensus metadata
I20260808 08:33:44.707271 8289 ts_tablet_manager.cc:1918] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:33:44.707392 8291 ts_tablet_manager.cc:1939] T 69d08d2484fd4b728ccdf37e445bce40 P b21088cfc70f4d2ba436fbb63d67c175: Deleting consensus metadata
I20260808 08:33:44.707499 8289 log.cc:1196] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/69d08d2484fd4b728ccdf37e445bce40
I20260808 08:33:44.708331 8289 ts_tablet_manager.cc:1939] T 69d08d2484fd4b728ccdf37e445bce40 P d46f4e0b42b24e6588d12a139ccda22e: Deleting consensus metadata
I20260808 08:33:44.708870 7626 catalog_manager.cc:4841] TS b21088cfc70f4d2ba436fbb63d67c175 (127.5.164.194:36651): tablet 69d08d2484fd4b728ccdf37e445bce40 (table test-table [id=19d68c0ed60f4b76a978908d052161a9]) successfully deleted
I20260808 08:33:44.709159 7627 catalog_manager.cc:4841] TS 73b3fac3ffe14eec84694e3d145be193 (127.5.164.193:45707): tablet 69d08d2484fd4b728ccdf37e445bce40 (table test-table [id=19d68c0ed60f4b76a978908d052161a9]) successfully deleted
I20260808 08:33:44.709827 7625 catalog_manager.cc:4841] TS d46f4e0b42b24e6588d12a139ccda22e (127.5.164.195:38877): tablet 69d08d2484fd4b728ccdf37e445bce40 (table test-table [id=19d68c0ed60f4b76a978908d052161a9]) successfully deleted
Aug 08 08:33:44 dist-test-slave-chsk krb5kdc[7593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178024, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:33:44 dist-test-slave-chsk krb5kdc[7593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178024, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:44.761341 8299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:44.738301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54022 (local address 127.5.164.254:44357)
0808 08:33:44.738982 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:44.739084 (+ 102us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:44.739121 (+ 37us) server_negotiation.cc:407] Connection header received
0808 08:33:44.739266 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:44.739269 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:44.739342 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:44.739430 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:44.741545 (+ 2115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:44.742359 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:44.744016 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:44.744397 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:44.744541 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:44.753559 (+ 9018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:44.753564 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:44.753567 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:44.753601 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:44.757897 (+ 4296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:44.758906 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:44.758910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:44.758913 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:44.759086 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:44.759549 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:44.759556 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:44.759564 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:44.759906 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:44.760228 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:44.760513 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 08:33:44.760776 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":321,"threads_started":1}
I20260808 08:33:44.765084 7644 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54022:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:33:44.765789 7644 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:33:44.773154 7939 tablet_service.cc:1467] Processing CreateTablet for tablet 4266a3aaa251484d9fde72a282a4d738 (DEFAULT_TABLE table=test-table [id=2d9c2092723048b5a074ae5379a6a6bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:44.773396 8091 tablet_service.cc:1467] Processing CreateTablet for tablet 4266a3aaa251484d9fde72a282a4d738 (DEFAULT_TABLE table=test-table [id=2d9c2092723048b5a074ae5379a6a6bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:44.773873 7939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4266a3aaa251484d9fde72a282a4d738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:44.773976 8091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4266a3aaa251484d9fde72a282a4d738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:44.772908 7794 tablet_service.cc:1467] Processing CreateTablet for tablet 4266a3aaa251484d9fde72a282a4d738 (DEFAULT_TABLE table=test-table [id=2d9c2092723048b5a074ae5379a6a6bc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:44.775789 7794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4266a3aaa251484d9fde72a282a4d738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:44.782442 8301 tablet_bootstrap.cc:492] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e: Bootstrap starting.
I20260808 08:33:44.784142 8301 tablet_bootstrap.cc:654] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:44.787407 8301 tablet_bootstrap.cc:492] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e: No bootstrap required, opened a new log
I20260808 08:33:44.787590 8301 ts_tablet_manager.cc:1397] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260808 08:33:44.788475 8301 raft_consensus.cc:348] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:44.789127 8301 raft_consensus.cc:374] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:44.789373 8301 raft_consensus.cc:729] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d46f4e0b42b24e6588d12a139ccda22e, State: Initialized, Role: FOLLOWER
I20260808 08:33:44.789777 8301 consensus_queue.cc:260] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:44.790616 8301 ts_tablet_manager.cc:1428] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 08:33:44.790943 8302 tablet_bootstrap.cc:492] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175: Bootstrap starting.
I20260808 08:33:44.793963 8304 tablet_bootstrap.cc:492] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193: Bootstrap starting.
I20260808 08:33:44.795258 8302 tablet_bootstrap.cc:654] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:44.798640 8304 tablet_bootstrap.cc:654] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:44.800599 8302 tablet_bootstrap.cc:492] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175: No bootstrap required, opened a new log
I20260808 08:33:44.800932 8302 ts_tablet_manager.cc:1397] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.007s
I20260808 08:33:44.802621 8302 raft_consensus.cc:348] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:44.803120 8302 raft_consensus.cc:374] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:44.803354 8302 raft_consensus.cc:729] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b21088cfc70f4d2ba436fbb63d67c175, State: Initialized, Role: FOLLOWER
I20260808 08:33:44.803839 8302 consensus_queue.cc:260] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:44.805636 8302 ts_tablet_manager.cc:1428] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175: Time spent starting tablet: real 0.004s user 0.000s sys 0.006s
I20260808 08:33:44.805822 8304 tablet_bootstrap.cc:492] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193: No bootstrap required, opened a new log
I20260808 08:33:44.806094 8304 ts_tablet_manager.cc:1397] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.007s
I20260808 08:33:44.807410 8304 raft_consensus.cc:348] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:44.807763 8304 raft_consensus.cc:374] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:44.808002 8304 raft_consensus.cc:729] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73b3fac3ffe14eec84694e3d145be193, State: Initialized, Role: FOLLOWER
I20260808 08:33:44.808439 8304 consensus_queue.cc:260] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:44.809273 8304 ts_tablet_manager.cc:1428] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 08:33:44.811107 8263 raft_consensus.cc:482] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:44.811436 8263 raft_consensus.cc:504] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:44.812398 8263 leader_election.cc:288] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73b3fac3ffe14eec84694e3d145be193 (127.5.164.193:45707), b21088cfc70f4d2ba436fbb63d67c175 (127.5.164.194:36651)
I20260808 08:33:44.812916 7816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4266a3aaa251484d9fde72a282a4d738" candidate_uuid: "d46f4e0b42b24e6588d12a139ccda22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73b3fac3ffe14eec84694e3d145be193" is_pre_election: true
I20260808 08:33:44.813325 7967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4266a3aaa251484d9fde72a282a4d738" candidate_uuid: "d46f4e0b42b24e6588d12a139ccda22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b21088cfc70f4d2ba436fbb63d67c175" is_pre_election: true
I20260808 08:33:44.813413 7816 raft_consensus.cc:2454] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d46f4e0b42b24e6588d12a139ccda22e in term 0.
I20260808 08:33:44.813644 7967 raft_consensus.cc:2454] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d46f4e0b42b24e6588d12a139ccda22e in term 0.
I20260808 08:33:44.814061 8041 leader_election.cc:302] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73b3fac3ffe14eec84694e3d145be193, d46f4e0b42b24e6588d12a139ccda22e; no voters:
I20260808 08:33:44.814419 8263 raft_consensus.cc:2781] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:44.814621 8263 raft_consensus.cc:482] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:44.814779 8263 raft_consensus.cc:3037] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:44.818035 8263 raft_consensus.cc:504] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:44.818931 8263 leader_election.cc:288] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [CANDIDATE]: Term 1 election: Requested vote from peers 73b3fac3ffe14eec84694e3d145be193 (127.5.164.193:45707), b21088cfc70f4d2ba436fbb63d67c175 (127.5.164.194:36651)
I20260808 08:33:44.819422 7816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4266a3aaa251484d9fde72a282a4d738" candidate_uuid: "d46f4e0b42b24e6588d12a139ccda22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73b3fac3ffe14eec84694e3d145be193"
I20260808 08:33:44.819689 7816 raft_consensus.cc:3037] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:44.819609 7967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4266a3aaa251484d9fde72a282a4d738" candidate_uuid: "d46f4e0b42b24e6588d12a139ccda22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b21088cfc70f4d2ba436fbb63d67c175"
I20260808 08:33:44.819921 7967 raft_consensus.cc:3037] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:44.822647 7816 raft_consensus.cc:2454] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d46f4e0b42b24e6588d12a139ccda22e in term 1.
I20260808 08:33:44.822724 7967 raft_consensus.cc:2454] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d46f4e0b42b24e6588d12a139ccda22e in term 1.
I20260808 08:33:44.823251 8041 leader_election.cc:302] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73b3fac3ffe14eec84694e3d145be193, d46f4e0b42b24e6588d12a139ccda22e; no voters:
I20260808 08:33:44.823688 8263 raft_consensus.cc:2781] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:44.823906 8263 raft_consensus.cc:686] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [term 1 LEADER]: Becoming Leader. State: Replica: d46f4e0b42b24e6588d12a139ccda22e, State: Running, Role: LEADER
I20260808 08:33:44.824527 8263 consensus_queue.cc:237] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:44.828187 7644 catalog_manager.cc:5495] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e reported cstate change: term changed from 0 to 1, leader changed from <none> to d46f4e0b42b24e6588d12a139ccda22e (127.5.164.195). New cstate: current_term: 1 leader_uuid: "d46f4e0b42b24e6588d12a139ccda22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } health_report { overall_health: HEALTHY } } }
I20260808 08:33:44.864627 8310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:44.857373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53736 (local address 127.5.164.195:38877)
0808 08:33:44.858504 (+ 1131us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:44.858509 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:44.858547 (+ 38us) server_negotiation.cc:407] Connection header received
0808 08:33:44.858598 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:44.858601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:44.858660 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:44.858931 (+ 271us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:44.859499 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:44.860561 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:44.862193 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:44.862867 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:44.862962 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:44.863656 (+ 694us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:44.863799 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:44.863868 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:44.864004 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 08:33:44.864066 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1006,"thread_start_us":690,"threads_started":1}
I20260808 08:33:44.882333 8310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:44.875556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:34519 (local address 127.5.164.195:38877)
0808 08:33:44.875717 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:44.875721 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:44.876723 (+ 1002us) server_negotiation.cc:407] Connection header received
0808 08:33:44.876882 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:44.876885 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:44.876943 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:44.877014 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:33:44.877529 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:44.878489 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:44.880424 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:44.880983 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:44.881079 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:44.881559 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:33:44.881653 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:33:44.881728 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:44.881843 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 08:33:44.881926 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 08:33:44.882474 8313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:44.875413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:38877 (local address 127.5.164.195:34519)
0808 08:33:44.876612 (+ 1199us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:44.876629 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:44.876782 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:44.877042 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:44.877045 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:44.877054 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:33:44.877409 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:44.877418 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:44.878664 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:44.878667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:44.880303 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:44.880315 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:44.881151 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:44.881157 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:44.881357 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:44.881394 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:33:44.881741 (+ 347us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:33:44.881749 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 08:33:44.881808 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 08:33:44.881928 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1045,"thread_start_us":788,"threads_started":1}
I20260808 08:33:44.890863 7967 raft_consensus.cc:1261] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Refusing update from remote peer d46f4e0b42b24e6588d12a139ccda22e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:44.890861 7816 raft_consensus.cc:1261] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Refusing update from remote peer d46f4e0b42b24e6588d12a139ccda22e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:44.891498 8263 consensus_queue.cc:1035] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:44.891935 8266 consensus_queue.cc:1035] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:44.955881 7644 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:44.956291 7644 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:44.960290 7644 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c: Sending DeleteTablet for 3 replicas of tablet 4266a3aaa251484d9fde72a282a4d738
I20260808 08:33:44.961174 7794 tablet_service.cc:1514] Processing DeleteTablet for tablet 4266a3aaa251484d9fde72a282a4d738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:44 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:45786
I20260808 08:33:44.961475 8288 tablet_replica.cc:330] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193: stopping tablet replica
I20260808 08:33:44.961448 7939 tablet_service.cc:1514] Processing DeleteTablet for tablet 4266a3aaa251484d9fde72a282a4d738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:44 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:60946
I20260808 08:33:44.961750 8288 raft_consensus.cc:2229] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:44.961858 8291 tablet_replica.cc:330] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175: stopping tablet replica
I20260808 08:33:44.962061 8288 raft_consensus.cc:2258] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:44.962239 8291 raft_consensus.cc:2229] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:44.962512 8291 raft_consensus.cc:2258] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:44.963842 8291 ts_tablet_manager.cc:1905] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:44.963842 8288 ts_tablet_manager.cc:1905] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:44.963955 7644 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54022:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:33:44.964875 7644 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:33:44.970799 8090 tablet_service.cc:1514] Processing DeleteTablet for tablet 4266a3aaa251484d9fde72a282a4d738 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:44 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:53710
I20260808 08:33:44.971232 8289 tablet_replica.cc:330] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e: stopping tablet replica
I20260808 08:33:44.971549 8289 raft_consensus.cc:2229] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:33:44.972376 8289 raft_consensus.cc:2258] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:44.974246 7794 tablet_service.cc:1467] Processing CreateTablet for tablet 71c2ba115a454e92aa1ced5107856c22 (DEFAULT_TABLE table=test-table [id=60bac463831049d0a8bb2b44de0dcf71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:44.974558 7939 tablet_service.cc:1467] Processing CreateTablet for tablet 71c2ba115a454e92aa1ced5107856c22 (DEFAULT_TABLE table=test-table [id=60bac463831049d0a8bb2b44de0dcf71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:44.974817 7794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71c2ba115a454e92aa1ced5107856c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:44.975080 7939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71c2ba115a454e92aa1ced5107856c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:44.975870 8291 ts_tablet_manager.cc:1918] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:33:44.976114 8291 log.cc:1196] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/4266a3aaa251484d9fde72a282a4d738
I20260808 08:33:44.976761 8291 ts_tablet_manager.cc:1939] T 4266a3aaa251484d9fde72a282a4d738 P b21088cfc70f4d2ba436fbb63d67c175: Deleting consensus metadata
I20260808 08:33:44.978138 7626 catalog_manager.cc:4841] TS b21088cfc70f4d2ba436fbb63d67c175 (127.5.164.194:36651): tablet 4266a3aaa251484d9fde72a282a4d738 (table test-table [id=2d9c2092723048b5a074ae5379a6a6bc]) successfully deleted
I20260808 08:33:44.978761 8289 ts_tablet_manager.cc:1905] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:44.983667 8302 tablet_bootstrap.cc:492] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175: Bootstrap starting.
I20260808 08:33:44.983750 8090 tablet_service.cc:1467] Processing CreateTablet for tablet 71c2ba115a454e92aa1ced5107856c22 (DEFAULT_TABLE table=test-table [id=60bac463831049d0a8bb2b44de0dcf71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:33:44.984316 8090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71c2ba115a454e92aa1ced5107856c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:44.986418 8302 tablet_bootstrap.cc:654] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:44.987617 8304 tablet_bootstrap.cc:492] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193: Bootstrap starting.
I20260808 08:33:44.990214 8304 tablet_bootstrap.cc:654] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:44.991298 8289 ts_tablet_manager.cc:1918] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:33:44.991474 8289 log.cc:1196] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/4266a3aaa251484d9fde72a282a4d738
I20260808 08:33:44.991978 8289 ts_tablet_manager.cc:1939] T 4266a3aaa251484d9fde72a282a4d738 P d46f4e0b42b24e6588d12a139ccda22e: Deleting consensus metadata
I20260808 08:33:44.993238 7625 catalog_manager.cc:4841] TS d46f4e0b42b24e6588d12a139ccda22e (127.5.164.195:38877): tablet 4266a3aaa251484d9fde72a282a4d738 (table test-table [id=2d9c2092723048b5a074ae5379a6a6bc]) successfully deleted
I20260808 08:33:44.997484 8288 ts_tablet_manager.cc:1918] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:33:44.997777 8288 log.cc:1196] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/4266a3aaa251484d9fde72a282a4d738
I20260808 08:33:44.998528 8288 ts_tablet_manager.cc:1939] T 4266a3aaa251484d9fde72a282a4d738 P 73b3fac3ffe14eec84694e3d145be193: Deleting consensus metadata
I20260808 08:33:44.999930 7627 catalog_manager.cc:4841] TS 73b3fac3ffe14eec84694e3d145be193 (127.5.164.193:45707): tablet 4266a3aaa251484d9fde72a282a4d738 (table test-table [id=2d9c2092723048b5a074ae5379a6a6bc]) successfully deleted
I20260808 08:33:45.002899 8301 tablet_bootstrap.cc:492] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e: Bootstrap starting.
I20260808 08:33:45.005424 8302 tablet_bootstrap.cc:492] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175: No bootstrap required, opened a new log
I20260808 08:33:45.005590 8301 tablet_bootstrap.cc:654] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:45.005826 8302 ts_tablet_manager.cc:1397] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175: Time spent bootstrapping tablet: real 0.022s user 0.017s sys 0.004s
I20260808 08:33:45.006964 8304 tablet_bootstrap.cc:492] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193: No bootstrap required, opened a new log
I20260808 08:33:45.007181 8304 ts_tablet_manager.cc:1397] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.007s
I20260808 08:33:45.007046 8302 raft_consensus.cc:348] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:45.007470 8302 raft_consensus.cc:374] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:45.007597 8302 raft_consensus.cc:729] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b21088cfc70f4d2ba436fbb63d67c175, State: Initialized, Role: FOLLOWER
I20260808 08:33:45.007938 8302 consensus_queue.cc:260] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:45.008226 8304 raft_consensus.cc:348] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:45.008577 8304 raft_consensus.cc:374] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:45.008687 8304 raft_consensus.cc:729] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73b3fac3ffe14eec84694e3d145be193, State: Initialized, Role: FOLLOWER
I20260808 08:33:45.009037 8304 consensus_queue.cc:260] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:45.010752 8304 ts_tablet_manager.cc:1428] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 08:33:45.013805 8302 ts_tablet_manager.cc:1428] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260808 08:33:45.016892 8301 tablet_bootstrap.cc:492] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e: No bootstrap required, opened a new log
I20260808 08:33:45.017122 8301 ts_tablet_manager.cc:1397] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.003s
I20260808 08:33:45.017833 8301 raft_consensus.cc:348] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:45.018090 8301 raft_consensus.cc:374] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:45.018206 8301 raft_consensus.cc:729] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d46f4e0b42b24e6588d12a139ccda22e, State: Initialized, Role: FOLLOWER
I20260808 08:33:45.018491 8301 consensus_queue.cc:260] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:45.019471 8301 ts_tablet_manager.cc:1428] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260808 08:33:45.069418 8266 raft_consensus.cc:482] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:33:45.069801 8266 raft_consensus.cc:504] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:45.070799 8266 leader_election.cc:288] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73b3fac3ffe14eec84694e3d145be193 (127.5.164.193:45707), b21088cfc70f4d2ba436fbb63d67c175 (127.5.164.194:36651)
I20260808 08:33:45.071587 7816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71c2ba115a454e92aa1ced5107856c22" candidate_uuid: "d46f4e0b42b24e6588d12a139ccda22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73b3fac3ffe14eec84694e3d145be193" is_pre_election: true
I20260808 08:33:45.071703 7967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71c2ba115a454e92aa1ced5107856c22" candidate_uuid: "d46f4e0b42b24e6588d12a139ccda22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b21088cfc70f4d2ba436fbb63d67c175" is_pre_election: true
I20260808 08:33:45.071872 7816 raft_consensus.cc:2454] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d46f4e0b42b24e6588d12a139ccda22e in term 0.
I20260808 08:33:45.072018 7967 raft_consensus.cc:2454] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d46f4e0b42b24e6588d12a139ccda22e in term 0.
I20260808 08:33:45.072480 8041 leader_election.cc:302] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73b3fac3ffe14eec84694e3d145be193, d46f4e0b42b24e6588d12a139ccda22e; no voters:
I20260808 08:33:45.073112 8266 raft_consensus.cc:2781] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:33:45.073235 8266 raft_consensus.cc:482] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:33:45.073351 8266 raft_consensus.cc:3037] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:45.076813 8266 raft_consensus.cc:504] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:45.077489 8266 leader_election.cc:288] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [CANDIDATE]: Term 1 election: Requested vote from peers 73b3fac3ffe14eec84694e3d145be193 (127.5.164.193:45707), b21088cfc70f4d2ba436fbb63d67c175 (127.5.164.194:36651)
I20260808 08:33:45.078073 7967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71c2ba115a454e92aa1ced5107856c22" candidate_uuid: "d46f4e0b42b24e6588d12a139ccda22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b21088cfc70f4d2ba436fbb63d67c175"
I20260808 08:33:45.078050 7816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71c2ba115a454e92aa1ced5107856c22" candidate_uuid: "d46f4e0b42b24e6588d12a139ccda22e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73b3fac3ffe14eec84694e3d145be193"
I20260808 08:33:45.078271 7816 raft_consensus.cc:3037] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:45.078364 7967 raft_consensus.cc:3037] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:45.080914 7967 raft_consensus.cc:2454] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d46f4e0b42b24e6588d12a139ccda22e in term 1.
I20260808 08:33:45.081537 8040 leader_election.cc:302] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b21088cfc70f4d2ba436fbb63d67c175, d46f4e0b42b24e6588d12a139ccda22e; no voters:
I20260808 08:33:45.081898 8266 raft_consensus.cc:2781] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:45.082036 7816 raft_consensus.cc:2454] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d46f4e0b42b24e6588d12a139ccda22e in term 1.
I20260808 08:33:45.082134 8266 raft_consensus.cc:686] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [term 1 LEADER]: Becoming Leader. State: Replica: d46f4e0b42b24e6588d12a139ccda22e, State: Running, Role: LEADER
I20260808 08:33:45.082427 8266 consensus_queue.cc:237] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } }
I20260808 08:33:45.085505 7641 catalog_manager.cc:5495] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e reported cstate change: term changed from 0 to 1, leader changed from <none> to d46f4e0b42b24e6588d12a139ccda22e (127.5.164.195). New cstate: current_term: 1 leader_uuid: "d46f4e0b42b24e6588d12a139ccda22e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d46f4e0b42b24e6588d12a139ccda22e" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 38877 } health_report { overall_health: HEALTHY } } }
I20260808 08:33:45.116074 7816 raft_consensus.cc:1261] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Refusing update from remote peer d46f4e0b42b24e6588d12a139ccda22e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:45.116328 7966 raft_consensus.cc:1261] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Refusing update from remote peer d46f4e0b42b24e6588d12a139ccda22e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:33:45.117069 8316 consensus_queue.cc:1035] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "73b3fac3ffe14eec84694e3d145be193" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 45707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:33:45.117517 8266 consensus_queue.cc:1035] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b21088cfc70f4d2ba436fbb63d67c175" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 08:33:45.145681 8317 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 08:33:46.743786 7641 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:46.744068 7641 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:33:46.749091 7641 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d838b47aef8a4c0ba54f1c8576fbd20c: Sending DeleteTablet for 3 replicas of tablet 71c2ba115a454e92aa1ced5107856c22
I20260808 08:33:46.750155 8091 tablet_service.cc:1514] Processing DeleteTablet for tablet 71c2ba115a454e92aa1ced5107856c22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:46 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:53710
I20260808 08:33:46.750191 7939 tablet_service.cc:1514] Processing DeleteTablet for tablet 71c2ba115a454e92aa1ced5107856c22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:46 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:60946
I20260808 08:33:46.750214 7794 tablet_service.cc:1514] Processing DeleteTablet for tablet 71c2ba115a454e92aa1ced5107856c22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:33:46 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:45786
I20260808 08:33:46.750976 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 7719
I20260808 08:33:46.765161 8348 tablet_replica.cc:330] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e: stopping tablet replica
I20260808 08:33:46.765420 8348 raft_consensus.cc:2229] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:33:46.765844 8348 raft_consensus.cc:2258] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:46.766333 8349 tablet_replica.cc:330] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175: stopping tablet replica
I20260808 08:33:46.766654 8349 raft_consensus.cc:2229] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:46.766999 8349 raft_consensus.cc:2258] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:46.767478 8348 ts_tablet_manager.cc:1905] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:46.767964 8350 tablet_replica.cc:330] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193: stopping tablet replica
I20260808 08:33:46.768244 8350 raft_consensus.cc:2229] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:33:46.768589 8350 raft_consensus.cc:2258] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:33:46.769543 8350 ts_tablet_manager.cc:1905] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:46.769539 8349 ts_tablet_manager.cc:1905] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:33:46.773522 8348 ts_tablet_manager.cc:1918] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:33:46.773695 8348 log.cc:1196] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/71c2ba115a454e92aa1ced5107856c22
I20260808 08:33:46.774461 8348 ts_tablet_manager.cc:1939] T 71c2ba115a454e92aa1ced5107856c22 P d46f4e0b42b24e6588d12a139ccda22e: Deleting consensus metadata
I20260808 08:33:46.775738 7625 catalog_manager.cc:4841] TS d46f4e0b42b24e6588d12a139ccda22e (127.5.164.195:38877): tablet 71c2ba115a454e92aa1ced5107856c22 (table test-table [id=60bac463831049d0a8bb2b44de0dcf71]) successfully deleted
I20260808 08:33:46.777706 8349 ts_tablet_manager.cc:1918] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:33:46.777866 8349 log.cc:1196] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/71c2ba115a454e92aa1ced5107856c22
I20260808 08:33:46.778463 8349 ts_tablet_manager.cc:1939] T 71c2ba115a454e92aa1ced5107856c22 P b21088cfc70f4d2ba436fbb63d67c175: Deleting consensus metadata
I20260808 08:33:46.778623 8350 ts_tablet_manager.cc:1918] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 08:33:46.778877 8350 log.cc:1196] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/71c2ba115a454e92aa1ced5107856c22
I20260808 08:33:46.779623 8350 ts_tablet_manager.cc:1939] T 71c2ba115a454e92aa1ced5107856c22 P 73b3fac3ffe14eec84694e3d145be193: Deleting consensus metadata
I20260808 08:33:46.779910 7626 catalog_manager.cc:4841] TS b21088cfc70f4d2ba436fbb63d67c175 (127.5.164.194:36651): tablet 71c2ba115a454e92aa1ced5107856c22 (table test-table [id=60bac463831049d0a8bb2b44de0dcf71]) successfully deleted
I20260808 08:33:46.780881 7627 catalog_manager.cc:4841] TS 73b3fac3ffe14eec84694e3d145be193 (127.5.164.193:45707): tablet 71c2ba115a454e92aa1ced5107856c22 (table test-table [id=60bac463831049d0a8bb2b44de0dcf71]) successfully deleted
Aug 08 08:33:46 dist-test-slave-chsk krb5kdc[7593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178024, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:33:46.792725 8352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:46.753162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45812 (local address 127.5.164.193:45707)
0808 08:33:46.764422 (+ 11260us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:46.764431 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:46.766088 (+ 1657us) server_negotiation.cc:407] Connection header received
0808 08:33:46.766178 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:46.766184 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:46.766304 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:46.766552 (+ 248us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:46.775827 (+ 9275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:46.776789 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:46.778291 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:46.779061 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:46.779305 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:46.785660 (+ 6355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:46.785677 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:46.785694 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:46.785728 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:46.789466 (+ 3738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:46.790156 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:46.790164 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:46.790166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:46.790341 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:46.790691 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:46.790694 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:46.790696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:46.791259 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:46.791575 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:46.791933 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 08:33:46.792227 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11072,"thread_start_us":10944,"threads_started":1}
W20260808 08:33:46.793603 7860 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45812
W20260808 08:33:46.794384 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 7719: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:33:46.794720 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 7719
I20260808 08:33:46.821856 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 7870
Aug 08 08:33:46 dist-test-slave-chsk krb5kdc[7593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178024, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:33:46.838083 8353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:46.822834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60978 (local address 127.5.164.194:36651)
0808 08:33:46.823708 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:46.823713 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:46.823729 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:33:46.823784 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:46.823787 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:46.823846 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:46.823973 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:46.825425 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:46.826324 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:46.827593 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:46.828000 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:46.828091 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:46.832588 (+ 4497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:46.832603 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:46.832620 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:46.832660 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:46.835544 (+ 2884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:46.836166 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:46.836173 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:46.836176 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:46.836328 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:46.836718 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:46.836722 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:46.836724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:46.837101 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:46.837335 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:46.837647 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 08:33:46.837817 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":741,"thread_start_us":550,"threads_started":1}
W20260808 08:33:46.838943 8013 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60978
W20260808 08:33:46.839867 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 7870: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:33:46.840031 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 7870
I20260808 08:33:46.868479 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 8022
Aug 08 08:33:46 dist-test-slave-chsk krb5kdc[7593](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178024, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:33:46.884140 8354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:46.869293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53740 (local address 127.5.164.195:38877)
0808 08:33:46.869884 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:46.869889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:46.869905 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:33:46.869960 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:46.869964 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:46.870028 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:46.870122 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:46.871512 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:46.872247 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:46.873420 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:46.873844 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:46.873936 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:46.878332 (+ 4396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:46.878350 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:46.878367 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:46.878403 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:46.881413 (+ 3010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:46.882117 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:46.882124 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:46.882126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:46.882256 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:46.882574 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:46.882578 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:46.882579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:46.882924 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:46.883259 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:46.883619 (+ 360us) server_negotiation.cc:299] Negotiation successful
0808 08:33:46.883802 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":318,"threads_started":1}
W20260808 08:33:46.884950 8163 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53740
W20260808 08:33:46.885583 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 8022: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:33:46.885773 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 8022
I20260808 08:33:46.914484 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 7606
I20260808 08:33:46.915737 7686 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:33:47.034533 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 7606
2026-08-08T08:33:47Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8526 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:33:47 dist-test-slave-chsk krb5kdc[8358](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:33:47 dist-test-slave-chsk krb5kdc[8358](info): set up 2 sockets
Aug 08 08:33:47 dist-test-slave-chsk krb5kdc[8358](info): commencing operation
krb5kdc: starting...
W20260808 08:33:48.181277 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.000s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:33:48 dist-test-slave-chsk krb5kdc[8358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:33:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:33:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:33:48.406452 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:43753
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:46383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:43753
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:48.740016 8371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:48.740311 8371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:48.740484 8371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:48.747720 8371 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:48.747830 8371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:48.747946 8371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:48.748050 8371 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:48.748150 8371 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:48.758185 8371 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:46383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:43753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:43753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:48.759589 8371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:48.760901 8371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:48.773576 8380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:48.773644 8378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:48.773605 8377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:48.773985 8371 server_base.cc:1034] running on GCE node
I20260808 08:33:48.775399 8371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:48.776929 8371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:48.778160 8371 hybrid_clock.cc:648] HybridClock initialized: now 1786178028778095 us; error 52 us; skew 500 ppm
I20260808 08:33:48.778475 8371 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:48 dist-test-slave-chsk krb5kdc[8358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178028, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:48.782352 8371 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:33:48.784044 8371 webserver.cc:460] Webserver started at http://127.5.164.254:39791/ using document root <none> and password file <none>
I20260808 08:33:48.784775 8371 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:48.784914 8371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:48.785264 8371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:48.788763 8371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "93a71d379f4a4b608f7915f11ef76346"
format_stamp: "Formatted at 2026-08-08 08:33:48 on dist-test-slave-chsk"
server_key: "e833e3a92465aa7ebc73c9d1cd36e2cd"
server_key_iv: "7bd15b6eb55ea84ba4a595031f714791"
server_key_version: "encryptionkey@0"
I20260808 08:33:48.789958 8371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "93a71d379f4a4b608f7915f11ef76346"
format_stamp: "Formatted at 2026-08-08 08:33:48 on dist-test-slave-chsk"
server_key: "e833e3a92465aa7ebc73c9d1cd36e2cd"
server_key_iv: "7bd15b6eb55ea84ba4a595031f714791"
server_key_version: "encryptionkey@0"
I20260808 08:33:48.795418 8371 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260808 08:33:48.798776 8387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:48.800115 8371 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:33:48.800329 8371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "93a71d379f4a4b608f7915f11ef76346"
format_stamp: "Formatted at 2026-08-08 08:33:48 on dist-test-slave-chsk"
server_key: "e833e3a92465aa7ebc73c9d1cd36e2cd"
server_key_iv: "7bd15b6eb55ea84ba4a595031f714791"
server_key_version: "encryptionkey@0"
I20260808 08:33:48.800529 8371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:48.826541 8371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:48.830634 8371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:48.830946 8371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:48.849265 8371 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:43753
I20260808 08:33:48.849273 8442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:43753 every 8 connection(s)
I20260808 08:33:48.850638 8371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:48.854233 8443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:48.858628 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 8371
I20260808 08:33:48.858867 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:33:48.859730 5779 external_mini_cluster.cc:1428] Setting key c219c9830e4f80549659e3fbe71cc8e7
I20260808 08:33:48.866164 8443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346: Bootstrap starting.
I20260808 08:33:48.869290 8443 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:48.870318 8443 log.cc:824] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:48.873183 8443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346: No bootstrap required, opened a new log
Aug 08 08:33:48 dist-test-slave-chsk krb5kdc[8358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178028, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:48.881700 8443 raft_consensus.cc:348] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93a71d379f4a4b608f7915f11ef76346" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43753 } }
I20260808 08:33:48.882261 8443 raft_consensus.cc:374] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:48.882392 8443 raft_consensus.cc:729] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93a71d379f4a4b608f7915f11ef76346, State: Initialized, Role: FOLLOWER
I20260808 08:33:48.883054 8443 consensus_queue.cc:260] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93a71d379f4a4b608f7915f11ef76346" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43753 } }
I20260808 08:33:48.883340 8446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:48.861927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44562 (local address 127.5.164.254:43753)
0808 08:33:48.862787 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:48.862799 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:48.862845 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:33:48.864918 (+ 2073us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:48.864940 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:48.865356 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:48.865737 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:48.867241 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:48.868558 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:48.869924 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:48.870646 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:48.870852 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:48.875174 (+ 4322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:48.875188 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:48.875213 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:48.875262 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:48.878553 (+ 3291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:48.879503 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:48.879511 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:48.879518 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:48.879717 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:48.880140 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:48.880147 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:48.880158 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:48.880764 (+ 606us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:48.881091 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:48.881562 (+ 471us) server_negotiation.cc:299] Negotiation successful
0808 08:33:48.882028 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":388,"threads_started":1}
I20260808 08:33:48.883388 8443 raft_consensus.cc:388] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:48.883528 8443 raft_consensus.cc:482] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:48.883736 8443 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:48.886847 8443 raft_consensus.cc:504] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93a71d379f4a4b608f7915f11ef76346" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43753 } }
I20260808 08:33:48.887445 8443 leader_election.cc:302] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 93a71d379f4a4b608f7915f11ef76346; no voters:
I20260808 08:33:48.888119 8443 leader_election.cc:288] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:33:48.888206 8448 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:48.889052 8448 raft_consensus.cc:686] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [term 1 LEADER]: Becoming Leader. State: Replica: 93a71d379f4a4b608f7915f11ef76346, State: Running, Role: LEADER
I20260808 08:33:48.889618 8448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93a71d379f4a4b608f7915f11ef76346" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43753 } }
I20260808 08:33:48.890309 8443 sys_catalog.cc:564] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:48.892532 8450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 93a71d379f4a4b608f7915f11ef76346. Latest consensus state: current_term: 1 leader_uuid: "93a71d379f4a4b608f7915f11ef76346" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93a71d379f4a4b608f7915f11ef76346" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43753 } } }
I20260808 08:33:48.893028 8450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:48.893923 8449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "93a71d379f4a4b608f7915f11ef76346" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "93a71d379f4a4b608f7915f11ef76346" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43753 } } }
I20260808 08:33:48.894320 8449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:48.896587 8454 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:48.903479 8454 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:48.912636 8454 catalog_manager.cc:1347] Generated new cluster ID: b21289a398ad42c2992060080760ddd8
I20260808 08:33:48.912766 8454 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:48.935052 8454 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:33:48.936434 8454 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:48.945869 8454 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 93a71d379f4a4b608f7915f11ef76346: Generated new TSK 0
I20260808 08:33:48.946914 8454 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:33:49.018843 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43753
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:46383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:49.381745 8473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:49.382097 8473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:49.382257 8473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:49.389967 8473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:49.390080 8473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:49.390255 8473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:33:49.400544 8473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:46383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:49.401881 8473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:49.403288 8473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:49.416702 8483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:49.416658 8479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:49.416765 8480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:49.417594 8473 server_base.cc:1034] running on GCE node
I20260808 08:33:49.418260 8473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:49.419318 8473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:49.420562 8473 hybrid_clock.cc:648] HybridClock initialized: now 1786178029420516 us; error 51 us; skew 500 ppm
I20260808 08:33:49.420919 8473 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:49 dist-test-slave-chsk krb5kdc[8358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178029, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:49.424270 8473 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:33:49.425884 8473 webserver.cc:460] Webserver started at http://127.5.164.193:46119/ using document root <none> and password file <none>
I20260808 08:33:49.426723 8473 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:49.426913 8473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:49.427320 8473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:49.430411 8473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "7f8763516ee04dd2a44f6729648413d1"
format_stamp: "Formatted at 2026-08-08 08:33:49 on dist-test-slave-chsk"
server_key: "877a033fddc1b1ba6ae616b03e15f295"
server_key_iv: "d41c43e0c68d4b5367fa2a15e7985608"
server_key_version: "encryptionkey@0"
I20260808 08:33:49.431329 8473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "7f8763516ee04dd2a44f6729648413d1"
format_stamp: "Formatted at 2026-08-08 08:33:49 on dist-test-slave-chsk"
server_key: "877a033fddc1b1ba6ae616b03e15f295"
server_key_iv: "d41c43e0c68d4b5367fa2a15e7985608"
server_key_version: "encryptionkey@0"
I20260808 08:33:49.436726 8473 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 08:33:49.440373 8491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:49.441707 8473 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:33:49.441891 8473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "7f8763516ee04dd2a44f6729648413d1"
format_stamp: "Formatted at 2026-08-08 08:33:49 on dist-test-slave-chsk"
server_key: "877a033fddc1b1ba6ae616b03e15f295"
server_key_iv: "d41c43e0c68d4b5367fa2a15e7985608"
server_key_version: "encryptionkey@0"
I20260808 08:33:49.442140 8473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:49.473609 8473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:49.477895 8473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:49.478212 8473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:49.479280 8473 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:49.480626 8473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:49.480744 8473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:49.480897 8473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:49.480980 8473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:49.514462 8473 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:36379
I20260808 08:33:49.514509 8614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:36379 every 8 connection(s)
I20260808 08:33:49.515856 8473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:33:49.516672 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 8473
I20260808 08:33:49.516932 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:33:49.517693 5779 external_mini_cluster.cc:1428] Setting key ad502915f7eb9b9040cc3c9a143fd8bf
Aug 08 08:33:49 dist-test-slave-chsk krb5kdc[8358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178029, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:49.536307 8617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.518875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:55583 (local address 127.5.164.254:43753)
0808 08:33:49.519396 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:49.519402 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:49.520509 (+ 1107us) server_negotiation.cc:407] Connection header received
0808 08:33:49.522321 (+ 1812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:49.522326 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:49.522410 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:49.522537 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:49.524088 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.524821 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.526366 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.526772 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.526908 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.530603 (+ 3695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:49.530609 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:49.530612 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:49.530642 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:49.533235 (+ 2593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:49.533959 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:49.533963 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:49.533965 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:49.534080 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:49.534516 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:49.534523 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:49.534531 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:49.534783 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:49.534940 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:49.535694 (+ 754us) server_negotiation.cc:299] Negotiation successful
0808 08:33:49.535936 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":274,"threads_started":1}
I20260808 08:33:49.537264 8618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:49.519562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:43753 (local address 127.5.164.193:55583)
0808 08:33:49.520347 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:49.520392 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:49.522055 (+ 1663us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:49.522773 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:49.522781 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:49.523368 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:49.523910 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.523927 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.524983 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.524995 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.526218 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:49.526229 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:49.527014 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:49.527023 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:49.527316 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:49.528010 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:49.528031 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:49.530393 (+ 2362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:49.533380 (+ 2987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:49.533389 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:49.533404 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:49.533822 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:49.534199 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:49.534204 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:49.534208 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:49.534392 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:49.534914 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:49.534921 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:49.535315 (+ 394us) client_negotiation.cc:769] Sending connection context
0808 08:33:49.535574 (+ 259us) client_negotiation.cc:240] Negotiation successful
0808 08:33:49.536074 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":349,"threads_started":1}
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
I20260808 08:33:49.538887 8615 heartbeater.cc:347] Connected to a master server at 127.5.164.254:43753
I20260808 08:33:49.539266 8615 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:49.540071 8615 heartbeater.cc:511] Master 127.5.164.254:43753 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
I20260808 08:33:49.542308 8404 ts_manager.cc:194] Registered new tserver with Master: 7f8763516ee04dd2a44f6729648413d1 (127.5.164.193:36379)
I20260808 08:33:49.543808 8404 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:55583
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:33:49.566799 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43753
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:46383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:49.903330 8621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:49.903609 8621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:49.903789 8621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:49.911299 8621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:49.911441 8621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:49.911620 8621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:33:49.921710 8621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:46383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:49.923053 8621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:49.924408 8621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:49.937785 8629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:49.937856 8632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:49.938858 8621 server_base.cc:1034] running on GCE node
W20260808 08:33:49.941809 8628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:49.942668 8621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:49.943697 8621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:49.944898 8621 hybrid_clock.cc:648] HybridClock initialized: now 1786178029944851 us; error 41 us; skew 500 ppm
I20260808 08:33:49.945217 8621 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:49 dist-test-slave-chsk krb5kdc[8358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178029, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:49.951874 8621 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:33:49.953349 8621 webserver.cc:460] Webserver started at http://127.5.164.194:45585/ using document root <none> and password file <none>
I20260808 08:33:49.954082 8621 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:49.954241 8621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:49.954577 8621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:49.957741 8621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "0d8f6fd6253a4252badb6b4d2cbd737d"
format_stamp: "Formatted at 2026-08-08 08:33:49 on dist-test-slave-chsk"
server_key: "db7c4d1c296a892352759eaabb199bf8"
server_key_iv: "c3be8b35080dce5a315eec0a9f4e9370"
server_key_version: "encryptionkey@0"
I20260808 08:33:49.958534 8621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "0d8f6fd6253a4252badb6b4d2cbd737d"
format_stamp: "Formatted at 2026-08-08 08:33:49 on dist-test-slave-chsk"
server_key: "db7c4d1c296a892352759eaabb199bf8"
server_key_iv: "c3be8b35080dce5a315eec0a9f4e9370"
server_key_version: "encryptionkey@0"
I20260808 08:33:49.963989 8621 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.006s
I20260808 08:33:49.967381 8639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:49.968631 8621 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:33:49.968811 8621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "0d8f6fd6253a4252badb6b4d2cbd737d"
format_stamp: "Formatted at 2026-08-08 08:33:49 on dist-test-slave-chsk"
server_key: "db7c4d1c296a892352759eaabb199bf8"
server_key_iv: "c3be8b35080dce5a315eec0a9f4e9370"
server_key_version: "encryptionkey@0"
I20260808 08:33:49.969007 8621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:49.987751 8621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:49.992275 8621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:49.992591 8621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:49.993556 8621 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:49.994987 8621 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:49.995095 8621 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:49.995273 8621 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:49.995325 8621 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:50.030961 8621 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:45823
I20260808 08:33:50.031006 8758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:45823 every 8 connection(s)
I20260808 08:33:50.032310 8621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:33:50.033583 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 8621
I20260808 08:33:50.033789 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:33:50.034374 5779 external_mini_cluster.cc:1428] Setting key f15667360340a309785fb4809133b1d2
Aug 08 08:33:50 dist-test-slave-chsk krb5kdc[8358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178029, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:50.054808 8617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.035226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:34767 (local address 127.5.164.254:43753)
0808 08:33:50.035428 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:50.035434 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:50.036781 (+ 1347us) server_negotiation.cc:407] Connection header received
0808 08:33:50.038668 (+ 1887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:50.038674 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:50.038771 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:50.038880 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:50.040411 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.041128 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.042696 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.043119 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.043301 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.047530 (+ 4229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:50.047539 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:50.047547 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:50.047593 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:50.051375 (+ 3782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:50.052120 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:50.052128 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:50.052135 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:50.052307 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:50.052734 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:50.052742 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:50.052748 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:50.053154 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:50.053327 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:50.054048 (+ 721us) server_negotiation.cc:299] Negotiation successful
0808 08:33:50.054329 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:33:50.055405 8761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.035769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:43753 (local address 127.5.164.194:34767)
0808 08:33:50.036625 (+ 856us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:50.036670 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:50.038411 (+ 1741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:50.039115 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:50.039123 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:50.039694 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:50.040240 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.040257 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.041301 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.041305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.042543 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.042556 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.043409 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.043417 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.043639 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.044338 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:50.044367 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:50.047289 (+ 2922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:50.051520 (+ 4231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:50.051526 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:50.051538 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:50.051979 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:50.052419 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:50.052422 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:50.052425 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:50.052599 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:50.053310 (+ 711us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:50.053319 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:50.053638 (+ 319us) client_negotiation.cc:769] Sending connection context
0808 08:33:50.053881 (+ 243us) client_negotiation.cc:240] Negotiation successful
0808 08:33:50.054265 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":344,"threads_started":1}
I20260808 08:33:50.056874 8759 heartbeater.cc:347] Connected to a master server at 127.5.164.254:43753
I20260808 08:33:50.057245 8759 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
I20260808 08:33:50.058211 8759 heartbeater.cc:511] Master 127.5.164.254:43753 requested a full tablet report, sending...
I20260808 08:33:50.059682 8404 ts_manager.cc:194] Registered new tserver with Master: 0d8f6fd6253a4252badb6b4d2cbd737d (127.5.164.194:45823)
I20260808 08:33:50.060602 8404 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:34767
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:33:50.087028 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43753
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:46383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:50.420110 8764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:50.420492 8764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:50.420670 8764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:50.428431 8764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:50.428607 8764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:50.428797 8764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:33:50.439301 8764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:46383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:50.440744 8764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:50.442173 8764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:50.456087 8773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:50.456182 8770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:50.456171 8771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:50.457496 8764 server_base.cc:1034] running on GCE node
I20260808 08:33:50.458098 8764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:50.459088 8764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:50.460348 8764 hybrid_clock.cc:648] HybridClock initialized: now 1786178030460305 us; error 30 us; skew 500 ppm
I20260808 08:33:50.460697 8764 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:50 dist-test-slave-chsk krb5kdc[8358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178030, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:50.464043 8764 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:33:50.465528 8764 webserver.cc:460] Webserver started at http://127.5.164.195:42963/ using document root <none> and password file <none>
I20260808 08:33:50.466202 8764 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:50.466305 8764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:50.466563 8764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:50.469753 8764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "3b3808c65a694e3b9f21de2c8c088cbe"
format_stamp: "Formatted at 2026-08-08 08:33:50 on dist-test-slave-chsk"
server_key: "8a96d191bb670ea0996df89814af25f9"
server_key_iv: "64f13874c613395d28d347589543057e"
server_key_version: "encryptionkey@0"
I20260808 08:33:50.470593 8764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "3b3808c65a694e3b9f21de2c8c088cbe"
format_stamp: "Formatted at 2026-08-08 08:33:50 on dist-test-slave-chsk"
server_key: "8a96d191bb670ea0996df89814af25f9"
server_key_iv: "64f13874c613395d28d347589543057e"
server_key_version: "encryptionkey@0"
I20260808 08:33:50.476260 8764 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260808 08:33:50.479950 8782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:50.481307 8764 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:33:50.481500 8764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "3b3808c65a694e3b9f21de2c8c088cbe"
format_stamp: "Formatted at 2026-08-08 08:33:50 on dist-test-slave-chsk"
server_key: "8a96d191bb670ea0996df89814af25f9"
server_key_iv: "64f13874c613395d28d347589543057e"
server_key_version: "encryptionkey@0"
I20260808 08:33:50.481756 8764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:50.500233 8764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:50.505151 8764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:50.505554 8764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:50.506863 8764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:50.508383 8764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:50.508495 8764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:50.508635 8764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:50.508726 8764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:50.544405 8764 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:35087
I20260808 08:33:50.544449 8904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:35087 every 8 connection(s)
I20260808 08:33:50.545917 8764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:33:50.546809 8615 heartbeater.cc:503] Master 127.5.164.254:43753 was elected leader, sending a full tablet report...
I20260808 08:33:50.549819 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 8764
I20260808 08:33:50.550030 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:33:50.550470 5779 external_mini_cluster.cc:1428] Setting key a0bcfbbb914d248ab347d2b23e850fd3
Aug 08 08:33:50 dist-test-slave-chsk krb5kdc[8358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178030, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:50.566490 8617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.548677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:58451 (local address 127.5.164.254:43753)
0808 08:33:50.548848 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:50.548852 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:50.550144 (+ 1292us) server_negotiation.cc:407] Connection header received
0808 08:33:50.552579 (+ 2435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:50.552584 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:50.552672 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:50.552789 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:50.554353 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.555126 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.556835 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.557240 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.557333 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.560776 (+ 3443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:50.560781 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:50.560784 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:50.560816 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:50.563358 (+ 2542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:50.564045 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:50.564050 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:50.564054 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:50.564218 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:50.564709 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:50.564714 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:50.564718 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:50.565027 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:50.565179 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:50.566054 (+ 875us) server_negotiation.cc:299] Negotiation successful
0808 08:33:50.566221 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:33:50.567505 8907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:50.549174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:43753 (local address 127.5.164.195:58451)
0808 08:33:50.549973 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:50.550027 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:50.552235 (+ 2208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:50.553002 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:50.553010 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:50.553644 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:50.554204 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.554222 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.555319 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.555323 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.556712 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:50.556725 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:50.557476 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:50.557482 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:50.557688 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:50.558316 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:50.558343 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:50.560568 (+ 2225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:50.563488 (+ 2920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:50.563495 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:50.563507 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:50.563944 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:50.564335 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:50.564340 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:50.564343 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:50.564585 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:50.565191 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:50.565201 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:50.565619 (+ 418us) client_negotiation.cc:769] Sending connection context
0808 08:33:50.565961 (+ 342us) client_negotiation.cc:240] Negotiation successful
0808 08:33:50.566358 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":703,"threads_started":1}
I20260808 08:33:50.568918 8905 heartbeater.cc:347] Connected to a master server at 127.5.164.254:43753
I20260808 08:33:50.569180 8905 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:50.569898 8905 heartbeater.cc:511] Master 127.5.164.254:43753 requested a full tablet report, sending...
I20260808 08:33:50.571341 8404 ts_manager.cc:194] Registered new tserver with Master: 3b3808c65a694e3b9f21de2c8c088cbe (127.5.164.195:35087)
I20260808 08:33:50.572146 8404 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:58451
I20260808 08:33:50.577870 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 08:33:50.614271 8617 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:33:50.611810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44576 (local address 127.5.164.254:43753)
0808 08:33:50.611990 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:50.611995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:50.612418 (+ 423us) server_negotiation.cc:407] Connection header received
0808 08:33:50.612632 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:50.612637 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:50.612712 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:50.612808 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:50.613980 (+ 1172us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44576: BlockingRecv error: recv got EOF from 127.0.0.1:44576 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:33:50.617614 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 8473
W20260808 08:33:50.620481 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 8473: Not authorized: Client connection negotiation failed: client connection to 127.5.164.193:36379: server requires authentication, but client does not have Kerberos credentials available
I20260808 08:33:50.620678 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 8473
I20260808 08:33:50.640321 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 8621
W20260808 08:33:50.643666 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 8621: Not authorized: Client connection negotiation failed: client connection to 127.5.164.194:45823: server requires authentication, but client does not have Kerberos credentials available
I20260808 08:33:50.643851 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 8621
I20260808 08:33:50.661875 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 8764
W20260808 08:33:50.665122 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 8764: Not authorized: Client connection negotiation failed: client connection to 127.5.164.195:35087: server requires authentication, but client does not have Kerberos credentials available
I20260808 08:33:50.665303 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 8764
I20260808 08:33:50.684144 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 8371
I20260808 08:33:50.685530 8437 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:33:50.797473 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 8371
2026-08-08T08:33:50Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3761 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:33:50 dist-test-slave-chsk krb5kdc[8926](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:33:50 dist-test-slave-chsk krb5kdc[8926](info): set up 2 sockets
Aug 08 08:33:50 dist-test-slave-chsk krb5kdc[8926](info): commencing operation
krb5kdc: starting...
W20260808 08:33:51.947669 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.004s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:33:52 dist-test-slave-chsk krb5kdc[8926](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:33:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:33:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:33:52.179292 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:40419
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:33801
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:40419
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:52.532446 8940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:52.532781 8940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:52.532938 8940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:52.540228 8940 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:52.540382 8940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:52.540470 8940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:52.540560 8940 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:52.540632 8940 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:52.551132 8940 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:33801
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:40419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:40419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:52.552531 8940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:52.553933 8940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:52.566026 8945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:52.566191 8948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:52.565917 8946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:52.567193 8940 server_base.cc:1034] running on GCE node
I20260808 08:33:52.568027 8940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:52.569475 8940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:52.570719 8940 hybrid_clock.cc:648] HybridClock initialized: now 1786178032570669 us; error 46 us; skew 500 ppm
I20260808 08:33:52.571076 8940 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:52 dist-test-slave-chsk krb5kdc[8926](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178032, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:52.574208 8940 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:33:52.575801 8940 webserver.cc:460] Webserver started at http://127.5.164.254:42705/ using document root <none> and password file <none>
I20260808 08:33:52.576433 8940 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:52.576534 8940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:52.576803 8940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:52.579815 8940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "6cd7d63695064c4fa582b560eb783af2"
format_stamp: "Formatted at 2026-08-08 08:33:52 on dist-test-slave-chsk"
server_key: "788f7579fa9af0ce912e838d10198c65"
server_key_iv: "63fcfdcd830bcb4ef23a7d682341c953"
server_key_version: "encryptionkey@0"
I20260808 08:33:52.580554 8940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "6cd7d63695064c4fa582b560eb783af2"
format_stamp: "Formatted at 2026-08-08 08:33:52 on dist-test-slave-chsk"
server_key: "788f7579fa9af0ce912e838d10198c65"
server_key_iv: "63fcfdcd830bcb4ef23a7d682341c953"
server_key_version: "encryptionkey@0"
I20260808 08:33:52.585708 8940 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:33:52.589301 8955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:52.590763 8940 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:33:52.590909 8940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "6cd7d63695064c4fa582b560eb783af2"
format_stamp: "Formatted at 2026-08-08 08:33:52 on dist-test-slave-chsk"
server_key: "788f7579fa9af0ce912e838d10198c65"
server_key_iv: "63fcfdcd830bcb4ef23a7d682341c953"
server_key_version: "encryptionkey@0"
I20260808 08:33:52.591082 8940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:52.607635 8940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:52.611619 8940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:52.611853 8940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:52.630815 8940 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:40419
I20260808 08:33:52.630857 9013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:40419 every 8 connection(s)
I20260808 08:33:52.632295 8940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:52.636102 9014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:52.641860 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 8940
I20260808 08:33:52.642105 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:33:52.642951 5779 external_mini_cluster.cc:1428] Setting key 52a55f53d0b0dae4bb04a9a73a33a64f
I20260808 08:33:52.648182 9014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2: Bootstrap starting.
I20260808 08:33:52.651298 9014 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:52.652344 9014 log.cc:824] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:52.655568 9014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2: No bootstrap required, opened a new log
Aug 08 08:33:52 dist-test-slave-chsk krb5kdc[8926](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:52.666137 9014 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cd7d63695064c4fa582b560eb783af2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40419 } }
I20260808 08:33:52.666617 9014 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:52.666759 9014 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cd7d63695064c4fa582b560eb783af2, State: Initialized, Role: FOLLOWER
I20260808 08:33:52.667500 9014 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cd7d63695064c4fa582b560eb783af2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40419 } }
I20260808 08:33:52.667819 9017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:52.645139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46480 (local address 127.5.164.254:40419)
0808 08:33:52.646069 (+ 930us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:52.646081 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:52.646132 (+ 51us) server_negotiation.cc:407] Connection header received
0808 08:33:52.647925 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:52.647948 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:52.648421 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:52.648814 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:52.650378 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:52.651828 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:52.653350 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:52.654292 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:52.654486 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:52.658674 (+ 4188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:52.658685 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:52.658704 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:52.658750 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:52.662942 (+ 4192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:52.663748 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:52.663756 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:52.663765 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:52.663997 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:52.664374 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:52.664379 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:52.664382 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:52.665161 (+ 779us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:52.665433 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:52.665865 (+ 432us) server_negotiation.cc:299] Negotiation successful
0808 08:33:52.666327 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":630,"thread_start_us":351,"threads_started":1}
I20260808 08:33:52.667825 9014 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:52.668038 9014 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:52.668249 9014 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:52.671243 9014 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cd7d63695064c4fa582b560eb783af2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40419 } }
I20260808 08:33:52.671805 9014 leader_election.cc:302] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cd7d63695064c4fa582b560eb783af2; no voters:
I20260808 08:33:52.671941 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:33:52.672533 9014 leader_election.cc:288] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:33:52.672640 9019 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:52.675124 9014 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:52.679666 9019 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [term 1 LEADER]: Becoming Leader. State: Replica: 6cd7d63695064c4fa582b560eb783af2, State: Running, Role: LEADER
I20260808 08:33:52.680431 9019 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cd7d63695064c4fa582b560eb783af2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40419 } }
I20260808 08:33:52.684056 9020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6cd7d63695064c4fa582b560eb783af2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cd7d63695064c4fa582b560eb783af2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40419 } } }
I20260808 08:33:52.684568 9020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:52.685328 9021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cd7d63695064c4fa582b560eb783af2. Latest consensus state: current_term: 1 leader_uuid: "6cd7d63695064c4fa582b560eb783af2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cd7d63695064c4fa582b560eb783af2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40419 } } }
I20260808 08:33:52.685711 9021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:52.687275 9036 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:52.692960 9036 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:52.701835 9036 catalog_manager.cc:1347] Generated new cluster ID: fd457600df96403e967999d36d1757f3
I20260808 08:33:52.701994 9036 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:52.719326 9036 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:33:52.721349 9036 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:52.730562 9017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:52.720429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46492 (local address 127.5.164.254:40419)
0808 08:33:52.720618 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:52.720625 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:52.721257 (+ 632us) server_negotiation.cc:407] Connection header received
0808 08:33:52.721473 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:52.721478 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:52.721558 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:52.721689 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:52.723075 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:52.724227 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:52.726197 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:52.726887 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:52.727014 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:52.728486 (+ 1472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:52.728493 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:52.728498 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:33:52.729631 (+ 1133us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:52.729732 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:33:52.729782 (+ 50us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:52.729899 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:52.730070 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 08:33:52.730180 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:33:52.732652 9036 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6cd7d63695064c4fa582b560eb783af2: Generated new TSK 0
I20260808 08:33:52.733491 9036 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:33:52.745328 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 8940
I20260808 08:33:52.746591 9009 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:33:52.840359 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 8940
2026-08-08T08:33:52Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2036 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:33:52 dist-test-slave-chsk krb5kdc[9052](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:33:52 dist-test-slave-chsk krb5kdc[9052](info): set up 2 sockets
Aug 08 08:33:52 dist-test-slave-chsk krb5kdc[9052](info): commencing operation
krb5kdc: starting...
W20260808 08:33:53.987082 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.004s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:33:54 dist-test-slave-chsk krb5kdc[9052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:33:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:33:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:33:54.218165 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:45049
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:45665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:45049
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:54.548599 9066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:54.548905 9066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:54.549075 9066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:54.556360 9066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:54.556473 9066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:54.556552 9066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:54.556675 9066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:54.556736 9066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:54.566642 9066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:45049
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:45049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:54.568032 9066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:54.569335 9066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:54.581420 9073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:54.581542 9075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:54.581566 9071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:54.582386 9066 server_base.cc:1034] running on GCE node
I20260808 08:33:54.583284 9066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:54.584726 9066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:54.585974 9066 hybrid_clock.cc:648] HybridClock initialized: now 1786178034585932 us; error 53 us; skew 500 ppm
I20260808 08:33:54.586364 9066 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:54 dist-test-slave-chsk krb5kdc[9052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178034, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:54.589668 9066 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:33:54.591338 9066 webserver.cc:460] Webserver started at http://127.5.164.254:46325/ using document root <none> and password file <none>
I20260808 08:33:54.592058 9066 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:54.592213 9066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:54.592535 9066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:54.595710 9066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "e036c8f00a9745edafb9627856e1b80d"
format_stamp: "Formatted at 2026-08-08 08:33:54 on dist-test-slave-chsk"
server_key: "2393ca557eec07b7803aa8839b0f68d1"
server_key_iv: "009109ed8d2528ee70be91c9f7f0b90c"
server_key_version: "encryptionkey@0"
I20260808 08:33:54.596522 9066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "e036c8f00a9745edafb9627856e1b80d"
format_stamp: "Formatted at 2026-08-08 08:33:54 on dist-test-slave-chsk"
server_key: "2393ca557eec07b7803aa8839b0f68d1"
server_key_iv: "009109ed8d2528ee70be91c9f7f0b90c"
server_key_version: "encryptionkey@0"
I20260808 08:33:54.601914 9066 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:33:54.605569 9084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:54.606909 9066 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:33:54.607227 9066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "e036c8f00a9745edafb9627856e1b80d"
format_stamp: "Formatted at 2026-08-08 08:33:54 on dist-test-slave-chsk"
server_key: "2393ca557eec07b7803aa8839b0f68d1"
server_key_iv: "009109ed8d2528ee70be91c9f7f0b90c"
server_key_version: "encryptionkey@0"
I20260808 08:33:54.607460 9066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:54.622231 9066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:54.627067 9066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:54.627421 9066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:54.646870 9066 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:45049
I20260808 08:33:54.646903 9139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:45049 every 8 connection(s)
I20260808 08:33:54.648362 9066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:54.650302 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 9066
I20260808 08:33:54.650538 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:33:54.651424 5779 external_mini_cluster.cc:1428] Setting key 09b9e07f54c62d9daa1082a9b12542fb
I20260808 08:33:54.653182 9140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:33:54 dist-test-slave-chsk krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:54.668005 9140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d: Bootstrap starting.
I20260808 08:33:54.671350 9140 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:54.672734 9140 log.cc:824] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:33:54.675730 9144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:54.653620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52740 (local address 127.5.164.254:45049)
0808 08:33:54.654410 (+ 790us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:54.654422 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:54.654463 (+ 41us) server_negotiation.cc:407] Connection header received
0808 08:33:54.656148 (+ 1685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:54.656169 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:54.656547 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:54.656871 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:54.658679 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.660083 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.661889 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:54.662583 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:54.662711 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:54.667966 (+ 5255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:54.667974 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:54.667994 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:54.668034 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:54.671298 (+ 3264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:54.672168 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:54.672175 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:54.672180 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:54.672360 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:54.672806 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:54.672809 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:54.672812 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:54.673522 (+ 710us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:54.673852 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:54.674246 (+ 394us) server_negotiation.cc:299] Negotiation successful
0808 08:33:54.674697 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":386,"threads_started":1}
I20260808 08:33:54.676102 9140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d: No bootstrap required, opened a new log
I20260808 08:33:54.683719 9140 raft_consensus.cc:348] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e036c8f00a9745edafb9627856e1b80d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45049 } }
I20260808 08:33:54.684161 9140 raft_consensus.cc:374] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:54.684279 9140 raft_consensus.cc:729] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e036c8f00a9745edafb9627856e1b80d, State: Initialized, Role: FOLLOWER
I20260808 08:33:54.684904 9140 consensus_queue.cc:260] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e036c8f00a9745edafb9627856e1b80d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45049 } }
I20260808 08:33:54.685165 9140 raft_consensus.cc:388] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:54.685318 9140 raft_consensus.cc:482] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:54.685509 9140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:54.687892 9140 raft_consensus.cc:504] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e036c8f00a9745edafb9627856e1b80d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45049 } }
I20260808 08:33:54.688447 9140 leader_election.cc:302] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e036c8f00a9745edafb9627856e1b80d; no voters:
I20260808 08:33:54.689052 9140 leader_election.cc:288] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:33:54.689183 9146 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:54.689972 9146 raft_consensus.cc:686] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [term 1 LEADER]: Becoming Leader. State: Replica: e036c8f00a9745edafb9627856e1b80d, State: Running, Role: LEADER
I20260808 08:33:54.690513 9146 consensus_queue.cc:237] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e036c8f00a9745edafb9627856e1b80d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45049 } }
I20260808 08:33:54.691304 9140 sys_catalog.cc:564] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:54.693735 9148 sys_catalog.cc:455] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e036c8f00a9745edafb9627856e1b80d. Latest consensus state: current_term: 1 leader_uuid: "e036c8f00a9745edafb9627856e1b80d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e036c8f00a9745edafb9627856e1b80d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45049 } } }
I20260808 08:33:54.694193 9148 sys_catalog.cc:458] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:54.694077 9147 sys_catalog.cc:455] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e036c8f00a9745edafb9627856e1b80d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e036c8f00a9745edafb9627856e1b80d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45049 } } }
I20260808 08:33:54.695803 9147 sys_catalog.cc:458] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:54.696825 9153 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:54.701380 9153 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:54.710286 9153 catalog_manager.cc:1347] Generated new cluster ID: d56a6220f34c42a5baed83feb8ab8d08
I20260808 08:33:54.710422 9153 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:54.731362 9153 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:33:54.732695 9153 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:54.744822 9153 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e036c8f00a9745edafb9627856e1b80d: Generated new TSK 0
I20260808 08:33:54.745657 9153 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:33:54.798854 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45049
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:45665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:55.135725 9168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:55.136016 9168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:55.136111 9168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:55.143528 9168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:55.143647 9168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:55.143766 9168 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:33:55.153621 9168 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:55.154966 9168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:55.156375 9168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:55.169920 9177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:55.169994 9174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:55.169988 9175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:55.170926 9168 server_base.cc:1034] running on GCE node
I20260808 08:33:55.171655 9168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:55.172665 9168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:55.173900 9168 hybrid_clock.cc:648] HybridClock initialized: now 1786178035173846 us; error 51 us; skew 500 ppm
I20260808 08:33:55.174225 9168 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:55 dist-test-slave-chsk krb5kdc[9052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178035, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:55.183624 9168 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:33:55.185191 9168 webserver.cc:460] Webserver started at http://127.5.164.193:39737/ using document root <none> and password file <none>
I20260808 08:33:55.185932 9168 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:55.186090 9168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:55.186437 9168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:55.189637 9168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "3a85e64e2a4a45268780fa53d0c2a9f0"
format_stamp: "Formatted at 2026-08-08 08:33:55 on dist-test-slave-chsk"
server_key: "130e38da8659714b1f3f35aaf3442097"
server_key_iv: "e5fdee6a77af747d2c851b1e0c7c0267"
server_key_version: "encryptionkey@0"
I20260808 08:33:55.190483 9168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "3a85e64e2a4a45268780fa53d0c2a9f0"
format_stamp: "Formatted at 2026-08-08 08:33:55 on dist-test-slave-chsk"
server_key: "130e38da8659714b1f3f35aaf3442097"
server_key_iv: "e5fdee6a77af747d2c851b1e0c7c0267"
server_key_version: "encryptionkey@0"
I20260808 08:33:55.196480 9168 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260808 08:33:55.200371 9185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:55.201725 9168 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260808 08:33:55.201924 9168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "3a85e64e2a4a45268780fa53d0c2a9f0"
format_stamp: "Formatted at 2026-08-08 08:33:55 on dist-test-slave-chsk"
server_key: "130e38da8659714b1f3f35aaf3442097"
server_key_iv: "e5fdee6a77af747d2c851b1e0c7c0267"
server_key_version: "encryptionkey@0"
I20260808 08:33:55.202174 9168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:55.218883 9168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:55.223857 9168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:55.224189 9168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:55.225279 9168 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:55.226771 9168 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:55.226881 9168 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:55.227034 9168 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:55.227110 9168 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:55.262756 9168 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:43585
I20260808 08:33:55.262813 9310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:43585 every 8 connection(s)
I20260808 08:33:55.264186 9168 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:33:55.274274 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 9168
I20260808 08:33:55.274503 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:33:55.275386 5779 external_mini_cluster.cc:1428] Setting key 392412f0ac735b6135151f80d96e0abd
Aug 08 08:33:55 dist-test-slave-chsk krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178035, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:55.287732 9314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:55.266875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:40275 (local address 127.5.164.254:45049)
0808 08:33:55.267442 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:55.267446 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:55.268393 (+ 947us) server_negotiation.cc:407] Connection header received
0808 08:33:55.270217 (+ 1824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:55.270223 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:55.270322 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:55.270450 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:55.272118 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:55.272863 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:55.275060 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:55.275581 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:55.275696 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:55.280083 (+ 4387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:55.280097 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:55.280101 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:55.280137 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:55.283892 (+ 3755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:55.284949 (+ 1057us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:55.284958 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:55.284964 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:55.285130 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:55.285656 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:55.285664 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:55.285670 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:55.286059 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:55.286242 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:55.287049 (+ 807us) server_negotiation.cc:299] Negotiation successful
0808 08:33:55.287345 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":353,"threads_started":1}
I20260808 08:33:55.288789 9315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:55.267516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:45049 (local address 127.5.164.193:40275)
0808 08:33:55.268220 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:55.268270 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:55.269938 (+ 1668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:55.270691 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:55.270700 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:55.271352 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:55.271935 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:55.271953 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:55.273053 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:55.273058 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:55.274874 (+ 1816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:55.274890 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:55.275834 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:55.275842 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:55.276157 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:55.276917 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:55.276943 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:55.279825 (+ 2882us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:55.284090 (+ 4265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:55.284104 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:55.284125 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:55.284786 (+ 661us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:55.285251 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:55.285258 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:55.285263 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:55.285519 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:55.286214 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:55.286223 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:55.286623 (+ 400us) client_negotiation.cc:769] Sending connection context
0808 08:33:55.286929 (+ 306us) client_negotiation.cc:240] Negotiation successful
0808 08:33:55.287538 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":272,"threads_started":1}
I20260808 08:33:55.290601 9312 heartbeater.cc:347] Connected to a master server at 127.5.164.254:45049
I20260808 08:33:55.290966 9312 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:55.291844 9312 heartbeater.cc:511] Master 127.5.164.254:45049 requested a full tablet report, sending...
I20260808 08:33:55.294432 9102 ts_manager.cc:194] Registered new tserver with Master: 3a85e64e2a4a45268780fa53d0c2a9f0 (127.5.164.193:43585)
I20260808 08:33:55.296818 9102 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:40275
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:33:55.330636 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45049
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:45665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:55.667693 9318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:55.667979 9318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:55.668087 9318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:55.675501 9318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:55.675616 9318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:55.675730 9318 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:33:55.685832 9318 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:55.687232 9318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:55.688565 9318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:55.702183 9324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:55.702214 9325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:55.702137 9327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:55.703289 9318 server_base.cc:1034] running on GCE node
I20260808 08:33:55.703951 9318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:55.704955 9318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:55.706197 9318 hybrid_clock.cc:648] HybridClock initialized: now 1786178035706140 us; error 49 us; skew 500 ppm
I20260808 08:33:55.706557 9318 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:55 dist-test-slave-chsk krb5kdc[9052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178035, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:55.710093 9318 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:33:55.711833 9318 webserver.cc:460] Webserver started at http://127.5.164.194:44225/ using document root <none> and password file <none>
I20260808 08:33:55.712672 9318 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:55.712836 9318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:55.713152 9318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:55.716183 9318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "1fb56b846c274c7d9c11e9b0d1f62dec"
format_stamp: "Formatted at 2026-08-08 08:33:55 on dist-test-slave-chsk"
server_key: "bcc1a595bf868df01898eae775c893bf"
server_key_iv: "d118e60cf1c2cb027d9aee64efc6da74"
server_key_version: "encryptionkey@0"
I20260808 08:33:55.716931 9318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "1fb56b846c274c7d9c11e9b0d1f62dec"
format_stamp: "Formatted at 2026-08-08 08:33:55 on dist-test-slave-chsk"
server_key: "bcc1a595bf868df01898eae775c893bf"
server_key_iv: "d118e60cf1c2cb027d9aee64efc6da74"
server_key_version: "encryptionkey@0"
I20260808 08:33:55.722470 9318 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:33:55.726270 9334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:55.727754 9318 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:33:55.727900 9318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "1fb56b846c274c7d9c11e9b0d1f62dec"
format_stamp: "Formatted at 2026-08-08 08:33:55 on dist-test-slave-chsk"
server_key: "bcc1a595bf868df01898eae775c893bf"
server_key_iv: "d118e60cf1c2cb027d9aee64efc6da74"
server_key_version: "encryptionkey@0"
I20260808 08:33:55.728119 9318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:55.744163 9318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:55.748647 9318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:55.748978 9318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:55.749996 9318 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:55.751479 9318 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:55.751585 9318 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:55.751740 9318 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:55.751813 9318 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:55.786970 9318 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:46701
I20260808 08:33:55.787031 9459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:46701 every 8 connection(s)
I20260808 08:33:55.788313 9318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:33:55.794711 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 9318
I20260808 08:33:55.794939 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:33:55.795604 5779 external_mini_cluster.cc:1428] Setting key 96eb8fbf95aca7da32b2c0cd5fe2b995
Aug 08 08:33:55 dist-test-slave-chsk krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178035, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:55.812305 9463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:55.790926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:48273 (local address 127.5.164.254:45049)
0808 08:33:55.791556 (+ 630us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:55.791567 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:55.792493 (+ 926us) server_negotiation.cc:407] Connection header received
0808 08:33:55.794628 (+ 2135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:55.794633 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:55.794708 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:55.794811 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:55.797016 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:55.798005 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:55.799855 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:55.800628 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:55.800794 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:55.805196 (+ 4402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:55.805206 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:55.805213 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:55.805265 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:55.808396 (+ 3131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:55.809519 (+ 1123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:55.809523 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:55.809525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:55.809668 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:55.810210 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:55.810213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:55.810215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:55.810491 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:55.810603 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:55.811693 (+ 1090us) server_negotiation.cc:299] Negotiation successful
0808 08:33:55.811968 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":323,"threads_started":1}
I20260808 08:33:55.813822 9464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:55.791571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:45049 (local address 127.5.164.194:48273)
0808 08:33:55.792318 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:55.792366 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:55.794266 (+ 1900us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:55.795132 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:55.795171 (+ 39us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:55.795985 (+ 814us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:55.796792 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:55.796820 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:55.798170 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:55.798174 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:55.799675 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:55.799694 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:55.800876 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:55.800881 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:55.801095 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:55.801857 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:55.801883 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:55.804903 (+ 3020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:55.808579 (+ 3676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:55.808593 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:55.808615 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:55.809376 (+ 761us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:55.809797 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:55.809804 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:55.809811 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:55.810086 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:55.810618 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:55.810629 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:55.811183 (+ 554us) client_negotiation.cc:769] Sending connection context
0808 08:33:55.811550 (+ 367us) client_negotiation.cc:240] Negotiation successful
0808 08:33:55.812246 (+ 696us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":285,"threads_started":1}
I20260808 08:33:55.815802 9461 heartbeater.cc:347] Connected to a master server at 127.5.164.254:45049
I20260808 08:33:55.816254 9461 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:55.817235 9461 heartbeater.cc:511] Master 127.5.164.254:45049 requested a full tablet report, sending...
I20260808 08:33:55.818964 9102 ts_manager.cc:194] Registered new tserver with Master: 1fb56b846c274c7d9c11e9b0d1f62dec (127.5.164.194:46701)
I20260808 08:33:55.819909 9102 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:48273
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:33:55.854532 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45049
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:45665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:56.197286 9467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:56.197638 9467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:56.197804 9467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:56.205343 9467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:56.205478 9467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:56.205598 9467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:33:56.216195 9467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:56.217689 9467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:56.219103 9467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:56.233398 9472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:56.233633 9475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:56.233392 9473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:56.234337 9467 server_base.cc:1034] running on GCE node
I20260808 08:33:56.234969 9467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:56.236006 9467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:56.237221 9467 hybrid_clock.cc:648] HybridClock initialized: now 1786178036237184 us; error 34 us; skew 500 ppm
I20260808 08:33:56.237578 9467 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:56 dist-test-slave-chsk krb5kdc[9052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178036, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:56.241122 9467 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:33:56.242760 9467 webserver.cc:460] Webserver started at http://127.5.164.195:35447/ using document root <none> and password file <none>
I20260808 08:33:56.243582 9467 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:56.243733 9467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:56.244087 9467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:56.247500 9467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "433d0706ebb642228a2f4d8150f920cb"
format_stamp: "Formatted at 2026-08-08 08:33:56 on dist-test-slave-chsk"
server_key: "55b28e22786a6206e54ecca8137a796e"
server_key_iv: "bce8373a0515d6587f65d2152432b2c2"
server_key_version: "encryptionkey@0"
I20260808 08:33:56.248445 9467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "433d0706ebb642228a2f4d8150f920cb"
format_stamp: "Formatted at 2026-08-08 08:33:56 on dist-test-slave-chsk"
server_key: "55b28e22786a6206e54ecca8137a796e"
server_key_iv: "bce8373a0515d6587f65d2152432b2c2"
server_key_version: "encryptionkey@0"
I20260808 08:33:56.254019 9467 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:33:56.257747 9482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:56.259048 9467 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:33:56.259265 9467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "433d0706ebb642228a2f4d8150f920cb"
format_stamp: "Formatted at 2026-08-08 08:33:56 on dist-test-slave-chsk"
server_key: "55b28e22786a6206e54ecca8137a796e"
server_key_iv: "bce8373a0515d6587f65d2152432b2c2"
server_key_version: "encryptionkey@0"
I20260808 08:33:56.259481 9467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:56.284330 9467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:56.289023 9467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:56.289363 9467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:56.290431 9467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:56.291921 9467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:56.291999 9467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:56.292126 9467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:56.292178 9467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:56.300304 9312 heartbeater.cc:503] Master 127.5.164.254:45049 was elected leader, sending a full tablet report...
I20260808 08:33:56.328096 9467 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:40205
I20260808 08:33:56.328141 9605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:40205 every 8 connection(s)
I20260808 08:33:56.329376 9467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:33:56.337435 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 9467
I20260808 08:33:56.337612 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:33:56.338070 5779 external_mini_cluster.cc:1428] Setting key 7f98a4085240482ccf64e68239505344
Aug 08 08:33:56 dist-test-slave-chsk krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178036, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:56.349539 9608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.331869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:36225 (local address 127.5.164.254:45049)
0808 08:33:56.332344 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:56.332348 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:56.333315 (+ 967us) server_negotiation.cc:407] Connection header received
0808 08:33:56.335198 (+ 1883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:56.335216 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:56.335305 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:56.335423 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:56.336864 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.337766 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.339648 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.340186 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.340352 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.343837 (+ 3485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:56.343842 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:56.343845 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:56.343877 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:56.346441 (+ 2564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:56.347177 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:56.347185 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:56.347190 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:56.347317 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:56.347743 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:56.347749 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:56.347753 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:56.348059 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:56.348241 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:56.348911 (+ 670us) server_negotiation.cc:299] Negotiation successful
0808 08:33:56.349156 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":239,"threads_started":1}
I20260808 08:33:56.350390 9609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.332397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:45049 (local address 127.5.164.195:36225)
0808 08:33:56.333146 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:56.333196 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:56.334882 (+ 1686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:56.335643 (+ 761us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:56.335652 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:56.336165 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:56.336694 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:56.336710 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.337921 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.337925 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:56.339486 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:56.339502 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.340439 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.340447 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:56.340682 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.341410 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:56.341433 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:56.343629 (+ 2196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:56.346577 (+ 2948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:56.346586 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:56.346600 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:56.347040 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:56.347434 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:56.347439 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:56.347442 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:56.347629 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:56.348206 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:56.348215 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:56.348531 (+ 316us) client_negotiation.cc:769] Sending connection context
0808 08:33:56.348789 (+ 258us) client_negotiation.cc:240] Negotiation successful
0808 08:33:56.349309 (+ 520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":317,"threads_started":1}
I20260808 08:33:56.351688 9606 heartbeater.cc:347] Connected to a master server at 127.5.164.254:45049
I20260808 08:33:56.352005 9606 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:56.352819 9606 heartbeater.cc:511] Master 127.5.164.254:45049 requested a full tablet report, sending...
I20260808 08:33:56.354254 9102 ts_manager.cc:194] Registered new tserver with Master: 433d0706ebb642228a2f4d8150f920cb (127.5.164.195:40205)
I20260808 08:33:56.355063 9102 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:36225
I20260808 08:33:56.365496 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:33:56 dist-test-slave-chsk krb5kdc[9052](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178036, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 08:33:56 dist-test-slave-chsk krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178036, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:56.418769 9608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.404934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52756 (local address 127.5.164.254:45049)
0808 08:33:56.405111 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:56.405115 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:56.405694 (+ 579us) server_negotiation.cc:407] Connection header received
0808 08:33:56.405833 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:56.405837 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:56.405926 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:56.406020 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:56.407505 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.408277 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.409478 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.409854 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.409944 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.413939 (+ 3995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:56.413944 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:56.413947 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:56.413980 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:56.416450 (+ 2470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:56.417059 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:56.417063 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:56.417065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:56.417179 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:56.417504 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:56.417507 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:56.417509 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:56.417827 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:56.418010 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:56.418232 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 08:33:56.418395 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260808 08:33:56.419355 9102 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52756
I20260808 08:33:56.420967 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 9168
Aug 08 08:33:56 dist-test-slave-chsk krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178036, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:33:56.436900 9618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.422135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37248 (local address 127.5.164.193:43585)
0808 08:33:56.422758 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:56.422766 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:56.422789 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:33:56.422842 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:56.422848 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:56.423046 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:56.423236 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:56.424432 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.425421 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.426793 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.427620 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.427741 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.431449 (+ 3708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:56.431461 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:56.431473 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:56.431503 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:56.434492 (+ 2989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:56.435174 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:56.435185 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:56.435189 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:56.435318 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:56.435645 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:56.435648 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:56.435650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:56.435972 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:56.436208 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:56.436405 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 08:33:56.436594 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":345,"threads_started":1}
W20260808 08:33:56.438192 9306 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:37248
W20260808 08:33:56.439256 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 9168: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:33:56.439487 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 9168
I20260808 08:33:56.457829 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 9318
Aug 08 08:33:56 dist-test-slave-chsk krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178036, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:33:56.474052 9619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.458787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54500 (local address 127.5.164.194:46701)
0808 08:33:56.459375 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:56.459382 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:56.459407 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:33:56.459465 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:56.459471 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:56.459674 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:56.459857 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:56.461147 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.462221 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.463628 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.464235 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.464396 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.468466 (+ 4070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:56.468477 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:56.468491 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:56.468523 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:56.471267 (+ 2744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:56.471889 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:56.471898 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:56.471902 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:56.472036 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:56.472426 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:56.472432 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:56.472436 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:56.472774 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:56.473095 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:56.473423 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 08:33:56.473704 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":275,"threads_started":1}
W20260808 08:33:56.475411 9455 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:54500
W20260808 08:33:56.476459 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 9318: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:33:56.476634 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 9318
I20260808 08:33:56.495234 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 9467
Aug 08 08:33:56 dist-test-slave-chsk krb5kdc[9052](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178036, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:33:56.511663 9620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:56.496204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48198 (local address 127.5.164.195:40205)
0808 08:33:56.496866 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:56.496872 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:56.496918 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:33:56.496976 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:56.496982 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:56.497188 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:56.497373 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:56.498713 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.499862 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.501086 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:56.501645 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:56.501798 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:56.506043 (+ 4245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:56.506054 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:56.506068 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:56.506104 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:56.508717 (+ 2613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:56.509374 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:56.509381 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:56.509384 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:56.509507 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:56.509877 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:56.509882 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:56.509886 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:56.510221 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:56.510541 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:56.510851 (+ 310us) server_negotiation.cc:299] Negotiation successful
0808 08:33:56.511164 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":345,"threads_started":1}
W20260808 08:33:56.513033 9601 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:48198
W20260808 08:33:56.514113 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 9467: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:33:56.514276 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 9467
I20260808 08:33:56.534742 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 9066
I20260808 08:33:56.536005 9135 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:33:56.641278 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 9066
2026-08-08T08:33:56Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3806 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:33:56 dist-test-slave-chsk krb5kdc[9625](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:33:56 dist-test-slave-chsk krb5kdc[9625](info): set up 2 sockets
Aug 08 08:33:56 dist-test-slave-chsk krb5kdc[9625](info): commencing operation
krb5kdc: starting...
W20260808 08:33:57.788283 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.001s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:33:57 dist-test-slave-chsk krb5kdc[9625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:33:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:33:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:33:58.031762 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:46197
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:35081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:46197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:58.382485 9638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:58.382901 9638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:58.383083 9638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:58.390602 9638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:33:58.390779 9638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:58.390897 9638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:58.391009 9638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:33:58.391103 9638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:33:58.401414 9638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:35081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:46197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:46197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:58.402895 9638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:58.404330 9638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:58.416898 9644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:58.416976 9646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:58.416973 9643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:58.417971 9638 server_base.cc:1034] running on GCE node
I20260808 08:33:58.418900 9638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:58.420529 9638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:58.421767 9638 hybrid_clock.cc:648] HybridClock initialized: now 1786178038421728 us; error 51 us; skew 500 ppm
I20260808 08:33:58.422161 9638 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:58 dist-test-slave-chsk krb5kdc[9625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178038, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:58.425420 9638 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:33:58.426941 9638 webserver.cc:460] Webserver started at http://127.5.164.254:35837/ using document root <none> and password file <none>
I20260808 08:33:58.427721 9638 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:58.427870 9638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:58.428215 9638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:58.431489 9638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "16483afce90742d9ad30f2fa16659189"
format_stamp: "Formatted at 2026-08-08 08:33:58 on dist-test-slave-chsk"
server_key: "2af05a1d73c18557a0f2fca0729a71e0"
server_key_iv: "533d2ebfa4da42f5c0de1e700283de52"
server_key_version: "encryptionkey@0"
I20260808 08:33:58.432331 9638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "16483afce90742d9ad30f2fa16659189"
format_stamp: "Formatted at 2026-08-08 08:33:58 on dist-test-slave-chsk"
server_key: "2af05a1d73c18557a0f2fca0729a71e0"
server_key_iv: "533d2ebfa4da42f5c0de1e700283de52"
server_key_version: "encryptionkey@0"
I20260808 08:33:58.437886 9638 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.005s
I20260808 08:33:58.441787 9654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:58.443334 9638 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 08:33:58.443535 9638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "16483afce90742d9ad30f2fa16659189"
format_stamp: "Formatted at 2026-08-08 08:33:58 on dist-test-slave-chsk"
server_key: "2af05a1d73c18557a0f2fca0729a71e0"
server_key_iv: "533d2ebfa4da42f5c0de1e700283de52"
server_key_version: "encryptionkey@0"
I20260808 08:33:58.443759 9638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:58.463268 9638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:58.467737 9638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:58.468056 9638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:58.487758 9638 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:46197
I20260808 08:33:58.487782 9708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:46197 every 8 connection(s)
I20260808 08:33:58.489259 9638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:33:58.493168 9709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:33:58.496923 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 9638
I20260808 08:33:58.497171 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:33:58.497828 5779 external_mini_cluster.cc:1428] Setting key 00da703759ebaf7d8ad8d68a58b05bca
I20260808 08:33:58.507026 9709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189: Bootstrap starting.
I20260808 08:33:58.511380 9709 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189: Neither blocks nor log segments found. Creating new log.
I20260808 08:33:58.512867 9709 log.cc:824] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:33:58 dist-test-slave-chsk krb5kdc[9625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178037, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:58.516961 9709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189: No bootstrap required, opened a new log
I20260808 08:33:58.524673 9712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:58.499956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44502 (local address 127.5.164.254:46197)
0808 08:33:58.500770 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:58.500782 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:58.500824 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:33:58.502493 (+ 1669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:58.502519 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:58.502947 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:58.503366 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:58.505272 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:58.506595 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:58.508444 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:58.509154 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:58.509289 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:58.514697 (+ 5408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:58.514708 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:58.514730 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:58.514781 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:58.519608 (+ 4827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:58.520456 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:58.520466 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:58.520475 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:58.520699 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:58.521095 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:58.521101 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:58.521105 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:58.521923 (+ 818us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:58.522269 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:58.522606 (+ 337us) server_negotiation.cc:299] Negotiation successful
0808 08:33:58.523119 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":388,"threads_started":1}
I20260808 08:33:58.527635 9709 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16483afce90742d9ad30f2fa16659189" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46197 } }
I20260808 08:33:58.528002 9709 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:33:58.528077 9709 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16483afce90742d9ad30f2fa16659189, State: Initialized, Role: FOLLOWER
I20260808 08:33:58.528674 9709 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16483afce90742d9ad30f2fa16659189" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46197 } }
I20260808 08:33:58.528944 9709 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:33:58.529095 9709 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:33:58.529277 9709 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:33:58.531939 9709 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16483afce90742d9ad30f2fa16659189" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46197 } }
I20260808 08:33:58.532450 9709 leader_election.cc:302] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16483afce90742d9ad30f2fa16659189; no voters:
I20260808 08:33:58.533102 9709 leader_election.cc:288] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:33:58.533277 9714 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:33:58.534782 9714 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [term 1 LEADER]: Becoming Leader. State: Replica: 16483afce90742d9ad30f2fa16659189, State: Running, Role: LEADER
I20260808 08:33:58.535389 9714 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16483afce90742d9ad30f2fa16659189" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46197 } }
I20260808 08:33:58.535799 9709 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:33:58.538280 9715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16483afce90742d9ad30f2fa16659189" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16483afce90742d9ad30f2fa16659189" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46197 } } }
I20260808 08:33:58.538710 9715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:58.539250 9716 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16483afce90742d9ad30f2fa16659189. Latest consensus state: current_term: 1 leader_uuid: "16483afce90742d9ad30f2fa16659189" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16483afce90742d9ad30f2fa16659189" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46197 } } }
I20260808 08:33:58.539547 9716 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189 [sys.catalog]: This master's current role is: LEADER
I20260808 08:33:58.539845 9723 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:33:58.546588 9723 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:33:58.559491 9723 catalog_manager.cc:1347] Generated new cluster ID: b7357cf20e504ec1a2d1c168061bdd0e
I20260808 08:33:58.559664 9723 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:33:58.576288 9723 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:33:58.577620 9723 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:33:58.594929 9723 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16483afce90742d9ad30f2fa16659189: Generated new TSK 0
I20260808 08:33:58.595927 9723 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:33:58.663712 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:46197
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:35081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:59.048547 9738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:59.048866 9738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:59.049052 9738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:59.057634 9738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:59.057775 9738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:59.057979 9738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:33:59.068432 9738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:35081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:46197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:59.069939 9738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:59.071478 9738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:59.085675 9743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:59.085592 9746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:59.085637 9744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:59.086510 9738 server_base.cc:1034] running on GCE node
I20260808 08:33:59.087299 9738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:59.088366 9738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:59.089653 9738 hybrid_clock.cc:648] HybridClock initialized: now 1786178039089506 us; error 154 us; skew 500 ppm
I20260808 08:33:59.089955 9738 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:59 dist-test-slave-chsk krb5kdc[9625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178039, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:59.093420 9738 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:33:59.095132 9738 webserver.cc:460] Webserver started at http://127.5.164.193:42677/ using document root <none> and password file <none>
I20260808 08:33:59.095922 9738 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:59.096076 9738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:59.096419 9738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:59.099628 9738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "f88ad29c862f40ac9b8e65cfbb12b841"
format_stamp: "Formatted at 2026-08-08 08:33:59 on dist-test-slave-chsk"
server_key: "cfd0b760a8ccba8baf708db2553ad601"
server_key_iv: "289f2ce6458776c0ac93a3e3a5947a94"
server_key_version: "encryptionkey@0"
I20260808 08:33:59.100500 9738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "f88ad29c862f40ac9b8e65cfbb12b841"
format_stamp: "Formatted at 2026-08-08 08:33:59 on dist-test-slave-chsk"
server_key: "cfd0b760a8ccba8baf708db2553ad601"
server_key_iv: "289f2ce6458776c0ac93a3e3a5947a94"
server_key_version: "encryptionkey@0"
I20260808 08:33:59.106240 9738 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:33:59.110044 9753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:59.111794 9738 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:33:59.112021 9738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "f88ad29c862f40ac9b8e65cfbb12b841"
format_stamp: "Formatted at 2026-08-08 08:33:59 on dist-test-slave-chsk"
server_key: "cfd0b760a8ccba8baf708db2553ad601"
server_key_iv: "289f2ce6458776c0ac93a3e3a5947a94"
server_key_version: "encryptionkey@0"
I20260808 08:33:59.112280 9738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:59.125530 9738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:59.130767 9738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:59.131246 9738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:59.132366 9738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:59.133809 9738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:59.133893 9738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:59.133980 9738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:59.134035 9738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:59.170126 9738 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:42917
I20260808 08:33:59.170179 9878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:42917 every 8 connection(s)
I20260808 08:33:59.171550 9738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:33:59.173209 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 9738
I20260808 08:33:59.173441 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:33:59.174149 5779 external_mini_cluster.cc:1428] Setting key e5fa9d4a82e690a1855aa7987f10fc2b
Aug 08 08:33:59 dist-test-slave-chsk krb5kdc[9625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178039, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:59.195755 9881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:59.174344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:47309 (local address 127.5.164.254:46197)
0808 08:33:59.174963 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:59.174974 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:59.176346 (+ 1372us) server_negotiation.cc:407] Connection header received
0808 08:33:59.178187 (+ 1841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:59.178196 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:59.178291 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:59.178419 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:59.180060 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:59.181219 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:59.183104 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:59.183829 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:59.183984 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:59.188905 (+ 4921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:59.188910 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:59.188913 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:59.188952 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:59.191785 (+ 2833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:59.192923 (+ 1138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:59.192927 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:59.192930 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:59.193065 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:59.193685 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:59.193688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:59.193690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:59.193977 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:59.194101 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:59.195284 (+ 1183us) server_negotiation.cc:299] Negotiation successful
0808 08:33:59.195477 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":235,"threads_started":1}
I20260808 08:33:59.197510 9884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:59.175064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:46197 (local address 127.5.164.193:47309)
0808 08:33:59.176068 (+ 1004us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:59.176122 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:59.177895 (+ 1773us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:59.178621 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:59.178628 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:59.179293 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:59.179876 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:59.179894 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:59.181422 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:59.181427 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:59.182904 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:59.182925 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:59.184111 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:59.184118 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:59.184349 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:59.185185 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:59.185225 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:59.188618 (+ 3393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:59.191962 (+ 3344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:59.191976 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:59.192011 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:59.192782 (+ 771us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:59.193208 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:59.193218 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:59.193225 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:59.193558 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:59.194119 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:59.194131 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:59.194732 (+ 601us) client_negotiation.cc:769] Sending connection context
0808 08:33:59.195133 (+ 401us) client_negotiation.cc:240] Negotiation successful
0808 08:33:59.195846 (+ 713us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":361,"threads_started":1}
I20260808 08:33:59.199388 9879 heartbeater.cc:347] Connected to a master server at 127.5.164.254:46197
I20260808 08:33:59.199775 9879 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:59.200599 9879 heartbeater.cc:511] Master 127.5.164.254:46197 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
I20260808 08:33:59.203289 9671 ts_manager.cc:194] Registered new tserver with Master: f88ad29c862f40ac9b8e65cfbb12b841 (127.5.164.193:42917)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
I20260808 08:33:59.205075 9671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:47309
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:33:59.234714 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:46197
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:35081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:33:59.570585 9887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:33:59.570909 9887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:33:59.571090 9887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:33:59.578545 9887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:33:59.578702 9887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:33:59.578894 9887 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:33:59.588901 9887 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:35081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:46197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:33:59.590273 9887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:33:59.591729 9887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:33:59.605489 9892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:59.605453 9895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:33:59.605453 9893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:33:59.606680 9887 server_base.cc:1034] running on GCE node
I20260808 08:33:59.607460 9887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:33:59.608474 9887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:33:59.609707 9887 hybrid_clock.cc:648] HybridClock initialized: now 1786178039609658 us; error 44 us; skew 500 ppm
I20260808 08:33:59.610052 9887 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:33:59 dist-test-slave-chsk krb5kdc[9625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178039, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:33:59.613394 9887 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:33:59.614830 9887 webserver.cc:460] Webserver started at http://127.5.164.194:39395/ using document root <none> and password file <none>
I20260808 08:33:59.615656 9887 fs_manager.cc:359] Metadata directory not provided
I20260808 08:33:59.615831 9887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:33:59.616147 9887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:33:59.619243 9887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "481e707e1e8349a4813855ceec93ba97"
format_stamp: "Formatted at 2026-08-08 08:33:59 on dist-test-slave-chsk"
server_key: "e6fb57a7921f0713ec5a0d5ed324d181"
server_key_iv: "4cf25109d29468552f142463e2099306"
server_key_version: "encryptionkey@0"
I20260808 08:33:59.620066 9887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "481e707e1e8349a4813855ceec93ba97"
format_stamp: "Formatted at 2026-08-08 08:33:59 on dist-test-slave-chsk"
server_key: "e6fb57a7921f0713ec5a0d5ed324d181"
server_key_iv: "4cf25109d29468552f142463e2099306"
server_key_version: "encryptionkey@0"
I20260808 08:33:59.625355 9887 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:33:59.628973 9903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:59.630280 9887 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:33:59.630466 9887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "481e707e1e8349a4813855ceec93ba97"
format_stamp: "Formatted at 2026-08-08 08:33:59 on dist-test-slave-chsk"
server_key: "e6fb57a7921f0713ec5a0d5ed324d181"
server_key_iv: "4cf25109d29468552f142463e2099306"
server_key_version: "encryptionkey@0"
I20260808 08:33:59.630682 9887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:33:59.653199 9887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:33:59.657851 9887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:33:59.658226 9887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:33:59.659283 9887 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:33:59.660707 9887 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:33:59.660830 9887 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:59.660983 9887 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:33:59.661072 9887 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:33:59.697417 9887 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:34763
I20260808 08:33:59.697515 10023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:34763 every 8 connection(s)
I20260808 08:33:59.698854 9887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:33:59.709143 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 9887
I20260808 08:33:59.709388 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:33:59.709913 5779 external_mini_cluster.cc:1428] Setting key ccd17d8db8352d39c6702774f90efbab
Aug 08 08:33:59 dist-test-slave-chsk krb5kdc[9625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178039, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:33:59.722132 10026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:59.701723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:60709 (local address 127.5.164.254:46197)
0808 08:33:59.702273 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0808 08:33:59.702280 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:33:59.703333 (+ 1053us) server_negotiation.cc:407] Connection header received
0808 08:33:59.705351 (+ 2018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:33:59.705356 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:33:59.705432 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:33:59.705534 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:33:59.707261 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:59.708027 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:59.709801 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:33:59.710471 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:33:59.710632 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:59.714498 (+ 3866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:33:59.714508 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:33:59.714515 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:33:59.714566 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:33:59.718550 (+ 3984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:59.719426 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:59.719434 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:59.719440 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:59.719624 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:33:59.720071 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:33:59.720079 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:33:59.720084 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:33:59.720506 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:33:59.720684 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 08:33:59.721378 (+ 694us) server_negotiation.cc:299] Negotiation successful
0808 08:33:59.721647 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":256,"threads_started":1}
I20260808 08:33:59.722944 10027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:33:59.702285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:46197 (local address 127.5.164.194:60709)
0808 08:33:59.703099 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0808 08:33:59.703204 (+ 105us) client_negotiation.cc:174] Beginning negotiation
0808 08:33:59.705072 (+ 1868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:33:59.705782 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:33:59.705790 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:33:59.706399 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:33:59.707020 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:59.707041 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:59.708208 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:59.708212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:59.709631 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:33:59.709646 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:33:59.710790 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:33:59.710800 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:33:59.711061 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:33:59.711835 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:33:59.711858 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:33:59.714249 (+ 2391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:33:59.718710 (+ 4461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:59.718717 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:59.718731 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:59.719286 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:59.719737 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:33:59.719741 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:33:59.719744 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:33:59.719947 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:33:59.720629 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:33:59.720634 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:33:59.720960 (+ 326us) client_negotiation.cc:769] Sending connection context
0808 08:33:59.721204 (+ 244us) client_negotiation.cc:240] Negotiation successful
0808 08:33:59.721637 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":317,"threads_started":1}
I20260808 08:33:59.724510 10024 heartbeater.cc:347] Connected to a master server at 127.5.164.254:46197
I20260808 08:33:59.724859 10024 heartbeater.cc:464] Registering TS with master...
I20260808 08:33:59.725734 10024 heartbeater.cc:511] Master 127.5.164.254:46197 requested a full tablet report, sending...
I20260808 08:33:59.727413 9671 ts_manager.cc:194] Registered new tserver with Master: 481e707e1e8349a4813855ceec93ba97 (127.5.164.194:34763)
I20260808 08:33:59.728377 9671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:60709
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:33:59.767243 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:46197
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:35081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:00.106212 10030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:00.106511 10030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:00.106678 10030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:00.114174 10030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:00.114289 10030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:00.114500 10030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:34:00.124656 10030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:35081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:46197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:00.125952 10030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:00.127355 10030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:00.141000 10038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:00.141093 10037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:00.141067 10040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:00.142083 10030 server_base.cc:1034] running on GCE node
I20260808 08:34:00.142640 10030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:00.143671 10030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:00.144933 10030 hybrid_clock.cc:648] HybridClock initialized: now 1786178040144886 us; error 36 us; skew 500 ppm
I20260808 08:34:00.145272 10030 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:00 dist-test-slave-chsk krb5kdc[9625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178040, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:00.148465 10030 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:34:00.149896 10030 webserver.cc:460] Webserver started at http://127.5.164.195:35013/ using document root <none> and password file <none>
I20260808 08:34:00.150544 10030 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:00.150650 10030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:00.150902 10030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:00.153873 10030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "af87b0638bf742359bdb38a226616328"
format_stamp: "Formatted at 2026-08-08 08:34:00 on dist-test-slave-chsk"
server_key: "15a859a497090c5dc015559e253c26da"
server_key_iv: "c52204cfeb8736152ea55f06c0e7a8ca"
server_key_version: "encryptionkey@0"
I20260808 08:34:00.154621 10030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "af87b0638bf742359bdb38a226616328"
format_stamp: "Formatted at 2026-08-08 08:34:00 on dist-test-slave-chsk"
server_key: "15a859a497090c5dc015559e253c26da"
server_key_iv: "c52204cfeb8736152ea55f06c0e7a8ca"
server_key_version: "encryptionkey@0"
I20260808 08:34:00.159899 10030 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 08:34:00.163734 10047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:00.165148 10030 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 08:34:00.165293 10030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "af87b0638bf742359bdb38a226616328"
format_stamp: "Formatted at 2026-08-08 08:34:00 on dist-test-slave-chsk"
server_key: "15a859a497090c5dc015559e253c26da"
server_key_iv: "c52204cfeb8736152ea55f06c0e7a8ca"
server_key_version: "encryptionkey@0"
I20260808 08:34:00.165473 10030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:00.200819 10030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:00.205196 10030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:00.205453 10030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:00.206401 10030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:00.207757 10030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:00.207830 10030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:00.207913 10030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:00.207964 10030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:00.208467 9879 heartbeater.cc:503] Master 127.5.164.254:46197 was elected leader, sending a full tablet report...
I20260808 08:34:00.245254 10030 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:39841
I20260808 08:34:00.245303 10172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:39841 every 8 connection(s)
I20260808 08:34:00.246601 10030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:34:00.251317 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 10030
I20260808 08:34:00.251535 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:34:00.252091 5779 external_mini_cluster.cc:1428] Setting key 3f82738ebd232677ea3f7fb40f160cf0
Aug 08 08:34:00 dist-test-slave-chsk krb5kdc[9625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178040, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:34:00.267493 10175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:00.249518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:45783 (local address 127.5.164.254:46197)
0808 08:34:00.250014 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:00.250019 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:00.251022 (+ 1003us) server_negotiation.cc:407] Connection header received
0808 08:34:00.253510 (+ 2488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:00.253518 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:00.253610 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:00.253700 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:00.255605 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.256389 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.257854 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.258233 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.258327 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:00.261743 (+ 3416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:00.261749 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:00.261752 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:00.261786 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:00.264406 (+ 2620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:00.265131 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:00.265135 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:00.265137 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:00.265263 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:00.265687 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:00.265691 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:00.265693 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:00.265962 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:00.266141 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:00.266813 (+ 672us) server_negotiation.cc:299] Negotiation successful
0808 08:34:00.267043 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":241,"threads_started":1}
I20260808 08:34:00.268467 10176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:00.250126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:46197 (local address 127.5.164.195:45783)
0808 08:34:00.250820 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:00.250884 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:00.253212 (+ 2328us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:00.253992 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:00.254000 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:00.254639 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:00.255431 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:00.255455 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.256518 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.256521 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:00.257729 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:00.257740 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.258414 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.258419 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:00.258607 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:00.259315 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:00.259338 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:00.261542 (+ 2204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:00.264551 (+ 3009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:00.264559 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:00.264570 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:00.265006 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:00.265358 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:00.265362 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:00.265364 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:00.265547 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:00.266107 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:00.266114 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:00.266444 (+ 330us) client_negotiation.cc:769] Sending connection context
0808 08:34:00.266701 (+ 257us) client_negotiation.cc:240] Negotiation successful
0808 08:34:00.267300 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":268,"threads_started":1}
I20260808 08:34:00.269831 10173 heartbeater.cc:347] Connected to a master server at 127.5.164.254:46197
I20260808 08:34:00.270152 10173 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:00.270864 10173 heartbeater.cc:511] Master 127.5.164.254:46197 requested a full tablet report, sending...
I20260808 08:34:00.272298 9671 ts_manager.cc:194] Registered new tserver with Master: af87b0638bf742359bdb38a226616328 (127.5.164.195:39841)
I20260808 08:34:00.273108 9671 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:45783
I20260808 08:34:00.279814 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:34:00 dist-test-slave-chsk krb5kdc[9625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:34:00 dist-test-slave-chsk krb5kdc[9625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:34:00.335259 10181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:00.319721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52370 (local address 127.5.164.193:42917)
0808 08:34:00.320387 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:00.320394 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:00.320424 (+ 30us) server_negotiation.cc:407] Connection header received
0808 08:34:00.320592 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:00.320599 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:00.320822 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:00.320956 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:00.322348 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.323461 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.324683 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.325217 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.325314 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:00.329226 (+ 3912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:00.329239 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:00.329254 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:00.329293 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:00.332199 (+ 2906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:00.332844 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:00.332851 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:00.332853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:00.332976 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:00.333457 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:00.333460 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:00.333462 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:00.333914 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:00.334241 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:00.334525 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 08:34:00.334823 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":307,"threads_started":1}
Aug 08 08:34:00 dist-test-slave-chsk krb5kdc[9625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:34:00.354058 10175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:00.340005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44512 (local address 127.5.164.254:46197)
0808 08:34:00.340247 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:00.340253 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:00.340420 (+ 167us) server_negotiation.cc:407] Connection header received
0808 08:34:00.340620 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:00.340624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:00.340707 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:00.340815 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:00.342115 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.342855 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.344283 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.344688 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.344827 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:00.348971 (+ 4144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:00.348976 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:00.348979 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:00.349012 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:00.351814 (+ 2802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:00.352386 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:00.352390 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:00.352392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:00.352511 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:00.352823 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:00.352826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:00.352828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:00.353132 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:00.353327 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:00.353565 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 08:34:00.353733 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
W20260808 08:34:00.354606 9671 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44512
I20260808 08:34:00.355634 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 9738
I20260808 08:34:00.367578 10181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:00.356555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52376 (local address 127.5.164.193:42917)
0808 08:34:00.356726 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:00.356730 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:00.357076 (+ 346us) server_negotiation.cc:407] Connection header received
0808 08:34:00.357204 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:00.357207 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:00.357268 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:00.357345 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:00.358426 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.359108 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.360295 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.360705 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.360796 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:00.363020 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:00.363025 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:00.363028 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:00.363057 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:00.365479 (+ 2422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:00.366041 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:00.366044 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:00.366046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:00.366164 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:00.366476 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:00.366478 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:00.366480 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:00.366712 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:00.366881 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:00.367127 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 08:34:00.367341 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:34:00.368161 9874 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:00.450363 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 9738
I20260808 08:34:00.469208 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 9887
Aug 08 08:34:00 dist-test-slave-chsk krb5kdc[9625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:34:00.486086 10187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:00.470258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34160 (local address 127.5.164.194:34763)
0808 08:34:00.470905 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:00.470912 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:00.470939 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:34:00.471002 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:00.471008 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:00.471294 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:00.471426 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:00.472608 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.473936 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.475436 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.475958 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.476055 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:00.480091 (+ 4036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:00.480102 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:00.480117 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:00.480165 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:00.483124 (+ 2959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:00.483923 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:00.483939 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:00.483942 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:00.484069 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:00.484461 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:00.484466 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:00.484469 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:00.484818 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:00.485138 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:00.485459 (+ 321us) server_negotiation.cc:299] Negotiation successful
0808 08:34:00.485739 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":353,"threads_started":1}
I20260808 08:34:00.487566 10019 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:00.574481 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 9887
I20260808 08:34:00.594165 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 10030
Aug 08 08:34:00 dist-test-slave-chsk krb5kdc[9625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:34:00.611275 10189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:00.595347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48454 (local address 127.5.164.195:39841)
0808 08:34:00.596043 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:00.596051 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:00.596082 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:34:00.596144 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:00.596150 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:00.596374 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:00.596507 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:00.597780 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.598826 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.600278 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:00.600854 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:00.600957 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:00.605464 (+ 4507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:00.605477 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:00.605492 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:00.605525 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:00.608498 (+ 2973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:00.609203 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:00.609210 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:00.609212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:00.609334 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:00.609660 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:00.609663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:00.609665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:00.609997 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:00.610248 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:00.610647 (+ 399us) server_negotiation.cc:299] Negotiation successful
0808 08:34:00.610864 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":364,"threads_started":1}
I20260808 08:34:00.612668 10167 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:00.700780 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 10030
I20260808 08:34:00.721392 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 9638
I20260808 08:34:00.722664 9704 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:00.828548 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 9638
2026-08-08T08:34:00Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4189 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:00 dist-test-slave-chsk krb5kdc[10195](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:00 dist-test-slave-chsk krb5kdc[10195](info): set up 2 sockets
Aug 08 08:34:00 dist-test-slave-chsk krb5kdc[10195](info): commencing operation
krb5kdc: starting...
W20260808 08:34:01.967787 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:34:02 dist-test-slave-chsk krb5kdc[10195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:34:02.202358 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:43777
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:41183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:43777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:02.553761 10210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:02.554093 10210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:02.554260 10210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:02.561342 10210 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:02.561489 10210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:02.561596 10210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:02.561700 10210 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:02.561793 10210 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:02.571578 10210 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:41183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:43777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:43777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:02.572918 10210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:02.574218 10210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:02.585847 10217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:02.585794 10220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:02.585798 10218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:02.586722 10210 server_base.cc:1034] running on GCE node
I20260808 08:34:02.587601 10210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:02.588997 10210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:02.590229 10210 hybrid_clock.cc:648] HybridClock initialized: now 1786178042590197 us; error 46 us; skew 500 ppm
I20260808 08:34:02.590569 10210 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:02 dist-test-slave-chsk krb5kdc[10195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178042, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:02.593704 10210 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:34:02.595016 10210 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:02.595105 10210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:02.595436 10210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:02.598279 10210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "b638feba66444917b2d197b49723d700"
format_stamp: "Formatted at 2026-08-08 08:34:02 on dist-test-slave-chsk"
server_key: "da06bed8bf99e787c770e77696a3769c"
server_key_iv: "4fc53edc8d4d37a532726c9d80886ec9"
server_key_version: "encryptionkey@0"
I20260808 08:34:02.599021 10210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "b638feba66444917b2d197b49723d700"
format_stamp: "Formatted at 2026-08-08 08:34:02 on dist-test-slave-chsk"
server_key: "da06bed8bf99e787c770e77696a3769c"
server_key_iv: "4fc53edc8d4d37a532726c9d80886ec9"
server_key_version: "encryptionkey@0"
I20260808 08:34:02.603998 10210 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:34:02.607437 10226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:02.608680 10210 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:34:02.608850 10210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "b638feba66444917b2d197b49723d700"
format_stamp: "Formatted at 2026-08-08 08:34:02 on dist-test-slave-chsk"
server_key: "da06bed8bf99e787c770e77696a3769c"
server_key_iv: "4fc53edc8d4d37a532726c9d80886ec9"
server_key_version: "encryptionkey@0"
I20260808 08:34:02.609071 10210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:02.658672 10210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:02.663391 10210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:02.663691 10210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:02.682797 10210 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:43777
I20260808 08:34:02.682823 10281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:43777 every 8 connection(s)
I20260808 08:34:02.683749 10210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:02.686434 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 10210
I20260808 08:34:02.686709 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:34:02.687567 5779 external_mini_cluster.cc:1428] Setting key f02c94f295b3cdaded5acd5cbc895cb6
I20260808 08:34:02.687945 10282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:02.703073 10282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700: Bootstrap starting.
Aug 08 08:34:02 dist-test-slave-chsk krb5kdc[10195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:34:02.706358 10282 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:02.707540 10282 log.cc:824] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:02.710625 10282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700: No bootstrap required, opened a new log
I20260808 08:34:02.711587 10285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:02.689695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48224 (local address 127.5.164.254:43777)
0808 08:34:02.690527 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:02.690541 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:02.690581 (+ 40us) server_negotiation.cc:407] Connection header received
0808 08:34:02.692651 (+ 2070us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:02.692671 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:02.693016 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:02.693334 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:02.695269 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:02.696565 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:02.698512 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:02.699293 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:02.699433 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:02.704237 (+ 4804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:02.704245 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:02.704259 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:02.704302 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:02.707454 (+ 3152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:02.708184 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:02.708190 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:02.708196 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:02.708374 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:02.708771 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:02.708776 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:02.708779 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:02.709280 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:02.709593 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:02.710159 (+ 566us) server_negotiation.cc:299] Negotiation successful
0808 08:34:02.710535 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":405,"threads_started":1}
I20260808 08:34:02.719067 10282 raft_consensus.cc:348] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b638feba66444917b2d197b49723d700" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43777 } }
I20260808 08:34:02.719599 10282 raft_consensus.cc:374] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:02.719724 10282 raft_consensus.cc:729] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b638feba66444917b2d197b49723d700, State: Initialized, Role: FOLLOWER
I20260808 08:34:02.720423 10282 consensus_queue.cc:260] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b638feba66444917b2d197b49723d700" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43777 } }
I20260808 08:34:02.720646 10282 raft_consensus.cc:388] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:02.720752 10282 raft_consensus.cc:482] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:02.720866 10282 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:02.723042 10282 raft_consensus.cc:504] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b638feba66444917b2d197b49723d700" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43777 } }
I20260808 08:34:02.723682 10282 leader_election.cc:302] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b638feba66444917b2d197b49723d700; no voters:
I20260808 08:34:02.724299 10282 leader_election.cc:288] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:02.724484 10287 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:02.726138 10287 raft_consensus.cc:686] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [term 1 LEADER]: Becoming Leader. State: Replica: b638feba66444917b2d197b49723d700, State: Running, Role: LEADER
I20260808 08:34:02.726662 10282 sys_catalog.cc:564] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:02.726723 10287 consensus_queue.cc:237] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b638feba66444917b2d197b49723d700" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43777 } }
I20260808 08:34:02.729966 10289 sys_catalog.cc:455] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b638feba66444917b2d197b49723d700. Latest consensus state: current_term: 1 leader_uuid: "b638feba66444917b2d197b49723d700" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b638feba66444917b2d197b49723d700" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43777 } } }
I20260808 08:34:02.730075 10288 sys_catalog.cc:455] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b638feba66444917b2d197b49723d700" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b638feba66444917b2d197b49723d700" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43777 } } }
I20260808 08:34:02.730396 10289 sys_catalog.cc:458] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:02.730402 10288 sys_catalog.cc:458] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:02.733304 10297 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:02.738375 10297 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:02.747592 10297 catalog_manager.cc:1347] Generated new cluster ID: f933c92c3d8e4f13b520dea27f0d841e
I20260808 08:34:02.747725 10297 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:02.780782 10297 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:02.782105 10297 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:02.801123 10297 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700: Generated new TSK 0
I20260808 08:34:02.802037 10297 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:34:02.864691 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43777
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:41183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:03.197435 10312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:03.197736 10312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:03.197908 10312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:03.205502 10312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:03.205624 10312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:03.205814 10312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:34:03.216511 10312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:41183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43777
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:03.217905 10312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:03.219369 10312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:03.233359 10317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:03.233441 10318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:03.233493 10320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:03.234222 10312 server_base.cc:1034] running on GCE node
I20260808 08:34:03.234875 10312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:03.235881 10312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:03.237092 10312 hybrid_clock.cc:648] HybridClock initialized: now 1786178043237052 us; error 37 us; skew 500 ppm
I20260808 08:34:03.237448 10312 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:03 dist-test-slave-chsk krb5kdc[10195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178043, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:03.240821 10312 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:34:03.242056 10312 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:03.242205 10312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:03.242528 10312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:03.245532 10312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "0b108e56f0f34869942b067168c56f25"
format_stamp: "Formatted at 2026-08-08 08:34:03 on dist-test-slave-chsk"
server_key: "b550d123ea46ef1da873c362791c862e"
server_key_iv: "9b05b5e869e4a2d88af671dcf9a7b37a"
server_key_version: "encryptionkey@0"
I20260808 08:34:03.246341 10312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "0b108e56f0f34869942b067168c56f25"
format_stamp: "Formatted at 2026-08-08 08:34:03 on dist-test-slave-chsk"
server_key: "b550d123ea46ef1da873c362791c862e"
server_key_iv: "9b05b5e869e4a2d88af671dcf9a7b37a"
server_key_version: "encryptionkey@0"
I20260808 08:34:03.251520 10312 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260808 08:34:03.254966 10327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:03.256361 10312 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:03.256542 10312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "0b108e56f0f34869942b067168c56f25"
format_stamp: "Formatted at 2026-08-08 08:34:03 on dist-test-slave-chsk"
server_key: "b550d123ea46ef1da873c362791c862e"
server_key_iv: "9b05b5e869e4a2d88af671dcf9a7b37a"
server_key_version: "encryptionkey@0"
I20260808 08:34:03.256774 10312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:03.280831 10312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:03.285368 10312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:03.285691 10312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:03.286679 10312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:03.288072 10312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:03.288213 10312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:03.288345 10312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:03.288437 10312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:03.323462 10312 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:44677
I20260808 08:34:03.323544 10445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:44677 every 8 connection(s)
I20260808 08:34:03.324388 10312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:34:03.329421 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 10312
I20260808 08:34:03.329658 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:34:03.330448 5779 external_mini_cluster.cc:1428] Setting key 9f7afb09c06cc5378259e9485336ac04
Aug 08 08:34:03 dist-test-slave-chsk krb5kdc[10195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178043, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:34:03.345718 10448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:03.326863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:50259 (local address 127.5.164.254:43777)
0808 08:34:03.327434 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:03.327439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:03.328300 (+ 861us) server_negotiation.cc:407] Connection header received
0808 08:34:03.330217 (+ 1917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:03.330222 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:03.330331 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:03.330452 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:03.332091 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:03.333048 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:03.334601 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:03.335371 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:03.335516 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:03.339113 (+ 3597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:03.339122 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:03.339130 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:03.339203 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:03.342326 (+ 3123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:03.343332 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:03.343336 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:03.343338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:03.343455 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:03.343951 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:03.343954 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:03.343956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:03.344214 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:03.344324 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:03.345278 (+ 954us) server_negotiation.cc:299] Negotiation successful
0808 08:34:03.345452 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":349,"threads_started":1}
I20260808 08:34:03.347364 10449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:03.327418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:43777 (local address 127.5.164.193:50259)
0808 08:34:03.328154 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:03.328190 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:03.329961 (+ 1771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:03.330673 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:03.330681 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:03.331258 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:03.331921 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:03.331938 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:03.333214 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:03.333218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:03.334442 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:03.334454 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:03.335577 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:03.335582 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:03.335779 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:03.336485 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:03.336508 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:03.338878 (+ 2370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:03.342478 (+ 3600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:03.342491 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:03.342511 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:03.343218 (+ 707us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:03.343564 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:03.343571 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:03.343577 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:03.343833 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:03.344353 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:03.344365 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:03.344870 (+ 505us) client_negotiation.cc:769] Sending connection context
0808 08:34:03.345174 (+ 304us) client_negotiation.cc:240] Negotiation successful
0808 08:34:03.345797 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":288,"threads_started":1}
I20260808 08:34:03.349120 10446 heartbeater.cc:347] Connected to a master server at 127.5.164.254:43777
I20260808 08:34:03.349457 10446 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:03.350145 10446 heartbeater.cc:511] Master 127.5.164.254:43777 requested a full tablet report, sending...
I20260808 08:34:03.352514 10245 ts_manager.cc:194] Registered new tserver with Master: 0b108e56f0f34869942b067168c56f25 (127.5.164.193:44677)
I20260808 08:34:03.353915 10245 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:50259
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:34:03.387015 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43777
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:41183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:03.730569 10453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:03.731024 10453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:03.731238 10453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:03.740724 10453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:03.740890 10453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:03.741027 10453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:34:03.751657 10453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:41183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43777
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:03.753194 10453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:03.754642 10453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:03.768249 10459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:03.768163 10460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:03.768195 10462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:03.772698 10453 server_base.cc:1034] running on GCE node
I20260808 08:34:03.773417 10453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:03.774374 10453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:03.775635 10453 hybrid_clock.cc:648] HybridClock initialized: now 1786178043775576 us; error 32 us; skew 500 ppm
I20260808 08:34:03.775962 10453 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:03 dist-test-slave-chsk krb5kdc[10195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178043, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:03.779489 10453 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:34:03.780694 10453 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:03.780830 10453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:03.781164 10453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:03.784266 10453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "7d50735705aa41008f11d35300f6987b"
format_stamp: "Formatted at 2026-08-08 08:34:03 on dist-test-slave-chsk"
server_key: "11b5289b32ef0cfc186167f56e74bcdb"
server_key_iv: "ff9210793aadacae071a96d937ec3ee6"
server_key_version: "encryptionkey@0"
I20260808 08:34:03.785107 10453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "7d50735705aa41008f11d35300f6987b"
format_stamp: "Formatted at 2026-08-08 08:34:03 on dist-test-slave-chsk"
server_key: "11b5289b32ef0cfc186167f56e74bcdb"
server_key_iv: "ff9210793aadacae071a96d937ec3ee6"
server_key_version: "encryptionkey@0"
I20260808 08:34:03.790369 10453 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:34:03.794091 10469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:03.795534 10453 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 08:34:03.795729 10453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "7d50735705aa41008f11d35300f6987b"
format_stamp: "Formatted at 2026-08-08 08:34:03 on dist-test-slave-chsk"
server_key: "11b5289b32ef0cfc186167f56e74bcdb"
server_key_iv: "ff9210793aadacae071a96d937ec3ee6"
server_key_version: "encryptionkey@0"
I20260808 08:34:03.795966 10453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:03.828349 10453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:03.832916 10453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:03.833230 10453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:03.834295 10453 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:03.835800 10453 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:03.835930 10453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:03.836052 10453 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:03.836156 10453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:03.873998 10453 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:37979
I20260808 08:34:03.874092 10586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:37979 every 8 connection(s)
I20260808 08:34:03.874912 10453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:34:03.882791 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 10453
I20260808 08:34:03.883049 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:34:03.883527 5779 external_mini_cluster.cc:1428] Setting key 3b9f02b118c526d6324b4ddf445e96f1
Aug 08 08:34:03 dist-test-slave-chsk krb5kdc[10195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178043, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:34:03.896735 10589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:03.877575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:36205 (local address 127.5.164.254:43777)
0808 08:34:03.878071 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:03.878078 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:03.879058 (+ 980us) server_negotiation.cc:407] Connection header received
0808 08:34:03.880971 (+ 1913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:03.880976 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:03.881065 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:03.881188 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:03.882850 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:03.883732 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:03.885748 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:03.886198 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:03.886295 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:03.890641 (+ 4346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:03.890646 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:03.890650 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:03.890684 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:03.893413 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:03.894227 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:03.894234 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:03.894237 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:03.894385 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:03.894837 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:03.894843 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:03.894846 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:03.895182 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:03.895350 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:03.896095 (+ 745us) server_negotiation.cc:299] Negotiation successful
0808 08:34:03.896338 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":237,"threads_started":1}
I20260808 08:34:03.897822 10590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:03.878171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:43777 (local address 127.5.164.194:36205)
0808 08:34:03.878896 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:03.878934 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:03.880690 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:03.881388 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:03.881397 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:03.881908 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:03.882646 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:03.882671 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:03.883899 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:03.883906 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:03.885605 (+ 1699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:03.885618 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:03.886442 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:03.886449 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:03.886772 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:03.887577 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:03.887614 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:03.890378 (+ 2764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:03.893581 (+ 3203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:03.893590 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:03.893610 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:03.894098 (+ 488us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:03.894505 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:03.894510 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:03.894514 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:03.894719 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:03.895323 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:03.895330 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:03.895709 (+ 379us) client_negotiation.cc:769] Sending connection context
0808 08:34:03.895998 (+ 289us) client_negotiation.cc:240] Negotiation successful
0808 08:34:03.896584 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":308,"threads_started":1}
I20260808 08:34:03.899627 10587 heartbeater.cc:347] Connected to a master server at 127.5.164.254:43777
I20260808 08:34:03.899964 10587 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:03.900696 10587 heartbeater.cc:511] Master 127.5.164.254:43777 requested a full tablet report, sending...
I20260808 08:34:03.902356 10245 ts_manager.cc:194] Registered new tserver with Master: 7d50735705aa41008f11d35300f6987b (127.5.164.194:37979)
I20260808 08:34:03.903800 10245 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:36205
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:34:03.939008 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43777
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:41183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:04.283087 10593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:04.283505 10593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:04.283713 10593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:04.291476 10593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:04.291630 10593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:04.291808 10593 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:34:04.302168 10593 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:41183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43777
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:04.303674 10593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:04.305051 10593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:04.318578 10599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:04.318693 10598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:04.318663 10601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:04.319339 10593 server_base.cc:1034] running on GCE node
I20260808 08:34:04.320230 10593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:04.321264 10593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:04.322525 10593 hybrid_clock.cc:648] HybridClock initialized: now 1786178044322463 us; error 69 us; skew 500 ppm
I20260808 08:34:04.322886 10593 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:04 dist-test-slave-chsk krb5kdc[10195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178044, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:04.326493 10593 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:34:04.328064 10593 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:04.328200 10593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:04.328522 10593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:04.331985 10593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "e02c4bc1a9024190bc54275a46c711b0"
format_stamp: "Formatted at 2026-08-08 08:34:04 on dist-test-slave-chsk"
server_key: "99c64e6269889afc850026d2bf11da57"
server_key_iv: "203cef0952cf46459df91ac0bdc908db"
server_key_version: "encryptionkey@0"
I20260808 08:34:04.332872 10593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "e02c4bc1a9024190bc54275a46c711b0"
format_stamp: "Formatted at 2026-08-08 08:34:04 on dist-test-slave-chsk"
server_key: "99c64e6269889afc850026d2bf11da57"
server_key_iv: "203cef0952cf46459df91ac0bdc908db"
server_key_version: "encryptionkey@0"
I20260808 08:34:04.338258 10593 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 08:34:04.342064 10608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:04.343582 10593 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:04.343786 10593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "e02c4bc1a9024190bc54275a46c711b0"
format_stamp: "Formatted at 2026-08-08 08:34:04 on dist-test-slave-chsk"
server_key: "99c64e6269889afc850026d2bf11da57"
server_key_iv: "203cef0952cf46459df91ac0bdc908db"
server_key_version: "encryptionkey@0"
I20260808 08:34:04.344031 10593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:04.357532 10446 heartbeater.cc:503] Master 127.5.164.254:43777 was elected leader, sending a full tablet report...
I20260808 08:34:04.357841 10593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:04.363193 10593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:04.363524 10593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:04.364590 10593 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:04.366016 10593 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:04.366135 10593 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:04.366269 10593 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:04.366362 10593 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:04.402920 10593 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:36677
I20260808 08:34:04.402998 10731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:36677 every 8 connection(s)
I20260808 08:34:04.404023 10593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:34:04.413662 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 10593
I20260808 08:34:04.413889 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:34:04.414341 5779 external_mini_cluster.cc:1428] Setting key b3ec644843a2b0d6af2a0cf8953bf07d
Aug 08 08:34:04 dist-test-slave-chsk krb5kdc[10195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178044, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:34:04.425912 10734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:04.406783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:52431 (local address 127.5.164.254:43777)
0808 08:34:04.407407 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:04.407411 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:04.408298 (+ 887us) server_negotiation.cc:407] Connection header received
0808 08:34:04.410284 (+ 1986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:04.410290 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:04.410395 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:04.410520 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:04.412343 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.413299 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.415281 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.415859 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.416009 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:04.419897 (+ 3888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:04.419903 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:04.419906 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:04.419943 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:04.422804 (+ 2861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:04.423736 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:04.423740 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:04.423742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:04.423873 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:04.424306 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:04.424309 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:04.424311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:04.424583 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:04.424705 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:04.425449 (+ 744us) server_negotiation.cc:299] Negotiation successful
0808 08:34:04.425630 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":516,"thread_start_us":376,"threads_started":1}
I20260808 08:34:04.426990 10735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:04.407347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:43777 (local address 127.5.164.195:52431)
0808 08:34:04.408100 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:04.408148 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:04.409956 (+ 1808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:04.410790 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:04.410798 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:04.411458 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:04.412120 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:04.412148 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.413508 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.413512 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:04.415096 (+ 1584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:04.415115 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.416093 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.416099 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:04.416302 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:04.417071 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:04.417108 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:04.419658 (+ 2550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:04.422974 (+ 3316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:04.422981 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:04.422996 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:04.423610 (+ 614us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:04.423986 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:04.423989 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:04.423992 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:04.424199 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:04.424715 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:04.424722 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:04.425089 (+ 367us) client_negotiation.cc:769] Sending connection context
0808 08:34:04.425337 (+ 248us) client_negotiation.cc:240] Negotiation successful
0808 08:34:04.425761 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":309,"threads_started":1}
I20260808 08:34:04.428712 10732 heartbeater.cc:347] Connected to a master server at 127.5.164.254:43777
I20260808 08:34:04.429106 10732 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:04.429972 10732 heartbeater.cc:511] Master 127.5.164.254:43777 requested a full tablet report, sending...
I20260808 08:34:04.431568 10245 ts_manager.cc:194] Registered new tserver with Master: e02c4bc1a9024190bc54275a46c711b0 (127.5.164.195:36677)
I20260808 08:34:04.432386 10245 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:52431
I20260808 08:34:04.443331 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:34:04.460923 10734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:04.448184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48228 (local address 127.5.164.254:43777)
0808 08:34:04.448444 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:04.448452 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:04.448943 (+ 491us) server_negotiation.cc:407] Connection header received
0808 08:34:04.449093 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:04.449097 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:04.449192 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:04.449284 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:04.450736 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.451543 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.452800 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.453260 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.453368 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:04.455756 (+ 2388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:04.455761 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:04.455764 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:04.455798 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:04.458356 (+ 2558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:04.458957 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:04.458960 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:04.458962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:04.459083 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:04.459491 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:04.459496 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:04.459498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:04.459898 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:04.460090 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:04.460388 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 08:34:04.460674 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:34:04.465189 10245 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48228:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:34:04.472095 10245 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:34:04.507550 10751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:04.485357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57294 (local address 127.5.164.195:36677)
0808 08:34:04.498346 (+ 12989us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:04.498357 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:04.498623 (+ 266us) server_negotiation.cc:407] Connection header received
0808 08:34:04.498804 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:04.498811 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:04.499026 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:04.499476 (+ 450us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:04.500781 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.502447 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.504878 (+ 2431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.506309 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.506654 (+ 345us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:04.506879 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:04.507013 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 08:34:04.507213 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12795,"thread_start_us":12588,"threads_started":1}
I20260808 08:34:04.507819 10749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:04.485007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42812 (local address 127.5.164.194:37979)
0808 08:34:04.498604 (+ 13597us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:04.498612 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:04.498648 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:34:04.498766 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:04.498774 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:04.499028 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:04.499718 (+ 690us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:04.500454 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.502069 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.504669 (+ 2600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.506144 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.506297 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:04.506533 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:04.507298 (+ 765us) server_negotiation.cc:299] Negotiation successful
0808 08:34:04.507465 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13453,"thread_start_us":13355,"threads_started":1}
I20260808 08:34:04.508024 10750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:04.484708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:37979 (local address 127.0.0.1:42812)
0808 08:34:04.497530 (+ 12822us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:04.497598 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:04.497833 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:04.499311 (+ 1478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:04.499320 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:04.499381 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:04.500061 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:04.500079 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.502264 (+ 2185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.502269 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:04.504491 (+ 2222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:04.504503 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.506365 (+ 1862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.506372 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:04.506615 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:04.506676 (+ 61us) client_negotiation.cc:769] Sending connection context
0808 08:34:04.506838 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 08:34:04.507051 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12452,"mutex_wait_us":219,"spinlock_wait_cycles":2304,"thread_start_us":13490,"threads_started":1}
I20260808 08:34:04.508536 10752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:04.498878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54964 (local address 127.5.164.193:44677)
0808 08:34:04.499570 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:04.499578 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:04.500738 (+ 1160us) server_negotiation.cc:407] Connection header received
0808 08:34:04.500887 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:04.500895 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:04.501126 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:04.501339 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:04.501935 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.503585 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.505667 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.506864 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.506988 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:04.507874 (+ 886us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:04.507949 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 08:34:04.508139 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":355,"threads_started":1}
I20260808 08:34:04.509124 10754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:04.499607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:44677 (local address 127.0.0.1:54964)
0808 08:34:04.500595 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:04.500612 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:04.500746 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:04.501352 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:04.501356 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:04.501380 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:04.501758 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:04.501769 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.503751 (+ 1982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.503757 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:04.505506 (+ 1749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:04.505517 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.507301 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.507309 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:04.507477 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:04.507508 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 08:34:04.507596 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 08:34:04.507731 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":862,"mutex_wait_us":1,"thread_start_us":666,"threads_started":1}
I20260808 08:34:04.509169 10748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:04.485033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:36677 (local address 127.0.0.1:57294)
0808 08:34:04.498489 (+ 13456us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:04.498509 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:04.498623 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:04.499311 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:04.499325 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:04.499381 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:04.500397 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:04.500410 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.502603 (+ 2193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.502608 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:04.504709 (+ 2101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:04.504724 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.506543 (+ 1819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.506552 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:04.506811 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:04.506855 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 08:34:04.506960 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 08:34:04.507092 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13318,"mutex_wait_us":293,"spinlock_wait_cycles":7168,"thread_start_us":11931,"threads_started":1}
I20260808 08:34:04.512658 10378 tablet_service.cc:1467] Processing CreateTablet for tablet 9a9b1bf111264c81a58ae8fb7105e90a (DEFAULT_TABLE table=test-table [id=fb536bb2c35f4e37ba15cbb19ab7d4df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:04.512665 10518 tablet_service.cc:1467] Processing CreateTablet for tablet 9a9b1bf111264c81a58ae8fb7105e90a (DEFAULT_TABLE table=test-table [id=fb536bb2c35f4e37ba15cbb19ab7d4df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:04.512665 10662 tablet_service.cc:1467] Processing CreateTablet for tablet 9a9b1bf111264c81a58ae8fb7105e90a (DEFAULT_TABLE table=test-table [id=fb536bb2c35f4e37ba15cbb19ab7d4df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:04.513980 10378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a9b1bf111264c81a58ae8fb7105e90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:04.514027 10518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a9b1bf111264c81a58ae8fb7105e90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:04.514026 10662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a9b1bf111264c81a58ae8fb7105e90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:04.527252 10755 tablet_bootstrap.cc:492] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25: Bootstrap starting.
I20260808 08:34:04.529019 10757 tablet_bootstrap.cc:492] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b: Bootstrap starting.
I20260808 08:34:04.529888 10756 tablet_bootstrap.cc:492] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0: Bootstrap starting.
I20260808 08:34:04.532135 10755 tablet_bootstrap.cc:654] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:04.532882 10757 tablet_bootstrap.cc:654] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:04.533495 10755 log.cc:824] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:04.533900 10757 log.cc:824] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:04.533978 10756 tablet_bootstrap.cc:654] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:04.535476 10756 log.cc:824] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:04.536969 10755 tablet_bootstrap.cc:492] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25: No bootstrap required, opened a new log
I20260808 08:34:04.536968 10757 tablet_bootstrap.cc:492] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b: No bootstrap required, opened a new log
I20260808 08:34:04.537254 10757 ts_tablet_manager.cc:1397] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260808 08:34:04.537248 10755 ts_tablet_manager.cc:1397] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260808 08:34:04.540130 10756 tablet_bootstrap.cc:492] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0: No bootstrap required, opened a new log
I20260808 08:34:04.540412 10756 ts_tablet_manager.cc:1397] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260808 08:34:04.548199 10756 raft_consensus.cc:348] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d50735705aa41008f11d35300f6987b" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 37979 } } peers { permanent_uuid: "e02c4bc1a9024190bc54275a46c711b0" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36677 } } peers { permanent_uuid: "0b108e56f0f34869942b067168c56f25" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44677 } }
I20260808 08:34:04.548594 10756 raft_consensus.cc:374] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:04.548729 10756 raft_consensus.cc:729] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e02c4bc1a9024190bc54275a46c711b0, State: Initialized, Role: FOLLOWER
I20260808 08:34:04.548519 10755 raft_consensus.cc:348] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d50735705aa41008f11d35300f6987b" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 37979 } } peers { permanent_uuid: "e02c4bc1a9024190bc54275a46c711b0" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36677 } } peers { permanent_uuid: "0b108e56f0f34869942b067168c56f25" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44677 } }
I20260808 08:34:04.548979 10755 raft_consensus.cc:374] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:04.549116 10755 raft_consensus.cc:729] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b108e56f0f34869942b067168c56f25, State: Initialized, Role: FOLLOWER
I20260808 08:34:04.548888 10757 raft_consensus.cc:348] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d50735705aa41008f11d35300f6987b" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 37979 } } peers { permanent_uuid: "e02c4bc1a9024190bc54275a46c711b0" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36677 } } peers { permanent_uuid: "0b108e56f0f34869942b067168c56f25" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44677 } }
I20260808 08:34:04.549305 10757 raft_consensus.cc:374] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:04.549468 10757 raft_consensus.cc:729] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d50735705aa41008f11d35300f6987b, State: Initialized, Role: FOLLOWER
I20260808 08:34:04.549489 10756 consensus_queue.cc:260] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d50735705aa41008f11d35300f6987b" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 37979 } } peers { permanent_uuid: "e02c4bc1a9024190bc54275a46c711b0" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36677 } } peers { permanent_uuid: "0b108e56f0f34869942b067168c56f25" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44677 } }
I20260808 08:34:04.549747 10755 consensus_queue.cc:260] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d50735705aa41008f11d35300f6987b" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 37979 } } peers { permanent_uuid: "e02c4bc1a9024190bc54275a46c711b0" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36677 } } peers { permanent_uuid: "0b108e56f0f34869942b067168c56f25" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44677 } }
I20260808 08:34:04.550107 10757 consensus_queue.cc:260] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d50735705aa41008f11d35300f6987b" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 37979 } } peers { permanent_uuid: "e02c4bc1a9024190bc54275a46c711b0" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36677 } } peers { permanent_uuid: "0b108e56f0f34869942b067168c56f25" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44677 } }
I20260808 08:34:04.552292 10732 heartbeater.cc:503] Master 127.5.164.254:43777 was elected leader, sending a full tablet report...
I20260808 08:34:04.553009 10756 ts_tablet_manager.cc:1428] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260808 08:34:04.554821 10755 ts_tablet_manager.cc:1428] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25: Time spent starting tablet: real 0.017s user 0.013s sys 0.004s
I20260808 08:34:04.555915 10587 heartbeater.cc:503] Master 127.5.164.254:43777 was elected leader, sending a full tablet report...
I20260808 08:34:04.557685 10757 ts_tablet_manager.cc:1428] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b: Time spent starting tablet: real 0.020s user 0.016s sys 0.003s
W20260808 08:34:04.576817 10447 tablet.cc:2369] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:34:04.627202 10588 tablet.cc:2369] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:34:04.655690 10733 tablet.cc:2369] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:34:04.774138 10762 raft_consensus.cc:482] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:34:04.774513 10762 raft_consensus.cc:504] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d50735705aa41008f11d35300f6987b" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 37979 } } peers { permanent_uuid: "e02c4bc1a9024190bc54275a46c711b0" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36677 } } peers { permanent_uuid: "0b108e56f0f34869942b067168c56f25" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44677 } }
I20260808 08:34:04.776350 10762 leader_election.cc:288] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d50735705aa41008f11d35300f6987b (127.5.164.194:37979), e02c4bc1a9024190bc54275a46c711b0 (127.5.164.195:36677)
I20260808 08:34:04.786127 10749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:04.776905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:37513 (local address 127.5.164.194:37979)
0808 08:34:04.777104 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:04.777111 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:04.777904 (+ 793us) server_negotiation.cc:407] Connection header received
0808 08:34:04.778132 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:04.778137 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:04.778222 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:04.778328 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:04.779395 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.780511 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.783661 (+ 3150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.784896 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.785081 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:04.785155 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:04.785711 (+ 556us) server_negotiation.cc:299] Negotiation successful
0808 08:34:04.785848 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:34:04.786139 10751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:04.776835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:51319 (local address 127.5.164.195:36677)
0808 08:34:04.777105 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:04.777112 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:04.777906 (+ 794us) server_negotiation.cc:407] Connection header received
0808 08:34:04.778146 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:04.778151 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:04.778223 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:04.778328 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:04.779395 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.780511 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.783654 (+ 3143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.784947 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.785092 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:04.785168 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:04.785711 (+ 543us) server_negotiation.cc:299] Negotiation successful
0808 08:34:04.785849 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 08:34:04.786391 10765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:04.776814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:37979 (local address 127.5.164.193:37513)
0808 08:34:04.777778 (+ 964us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:04.777794 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:04.777989 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:04.778363 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:04.778368 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:04.778404 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:04.779200 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:04.779222 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.780676 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.780682 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:04.783477 (+ 2795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:04.783492 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.785176 (+ 1684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.785184 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:04.785483 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:04.785567 (+ 84us) client_negotiation.cc:769] Sending connection context
0808 08:34:04.785667 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 08:34:04.785852 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":861,"mutex_wait_us":307,"spinlock_wait_cycles":43648,"thread_start_us":541,"threads_started":1}
I20260808 08:34:04.786413 10764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:04.776719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:36677 (local address 127.5.164.193:51319)
0808 08:34:04.777753 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:04.777778 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:04.777948 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:04.778363 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:04.778368 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:04.778411 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:04.779229 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:04.779238 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.780678 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.780682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:04.783476 (+ 2794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:04.783491 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.785198 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.785203 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:04.785490 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:04.785565 (+ 75us) client_negotiation.cc:769] Sending connection context
0808 08:34:04.785667 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 08:34:04.785852 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":884,"mutex_wait_us":388,"spinlock_wait_cycles":4864,"thread_start_us":623,"threads_started":1}
I20260808 08:34:04.787824 10683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a9b1bf111264c81a58ae8fb7105e90a" candidate_uuid: "0b108e56f0f34869942b067168c56f25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e02c4bc1a9024190bc54275a46c711b0" is_pre_election: true
I20260808 08:34:04.787824 10540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a9b1bf111264c81a58ae8fb7105e90a" candidate_uuid: "0b108e56f0f34869942b067168c56f25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d50735705aa41008f11d35300f6987b" is_pre_election: true
I20260808 08:34:04.788424 10683 raft_consensus.cc:2454] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b108e56f0f34869942b067168c56f25 in term 0.
I20260808 08:34:04.788424 10540 raft_consensus.cc:2454] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b108e56f0f34869942b067168c56f25 in term 0.
I20260808 08:34:04.789356 10331 leader_election.cc:302] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0b108e56f0f34869942b067168c56f25, 7d50735705aa41008f11d35300f6987b, e02c4bc1a9024190bc54275a46c711b0; no voters:
I20260808 08:34:04.789880 10762 raft_consensus.cc:2781] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:34:04.790055 10762 raft_consensus.cc:482] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:34:04.790172 10762 raft_consensus.cc:3037] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:04.792506 10762 raft_consensus.cc:504] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d50735705aa41008f11d35300f6987b" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 37979 } } peers { permanent_uuid: "e02c4bc1a9024190bc54275a46c711b0" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36677 } } peers { permanent_uuid: "0b108e56f0f34869942b067168c56f25" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44677 } }
I20260808 08:34:04.793138 10762 leader_election.cc:288] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [CANDIDATE]: Term 1 election: Requested vote from peers 7d50735705aa41008f11d35300f6987b (127.5.164.194:37979), e02c4bc1a9024190bc54275a46c711b0 (127.5.164.195:36677)
I20260808 08:34:04.793762 10540 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a9b1bf111264c81a58ae8fb7105e90a" candidate_uuid: "0b108e56f0f34869942b067168c56f25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d50735705aa41008f11d35300f6987b"
I20260808 08:34:04.793763 10683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a9b1bf111264c81a58ae8fb7105e90a" candidate_uuid: "0b108e56f0f34869942b067168c56f25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e02c4bc1a9024190bc54275a46c711b0"
I20260808 08:34:04.794013 10540 raft_consensus.cc:3037] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:04.794013 10683 raft_consensus.cc:3037] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:04.797436 10540 raft_consensus.cc:2454] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b108e56f0f34869942b067168c56f25 in term 1.
I20260808 08:34:04.797436 10683 raft_consensus.cc:2454] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b108e56f0f34869942b067168c56f25 in term 1.
I20260808 08:34:04.797968 10331 leader_election.cc:302] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0b108e56f0f34869942b067168c56f25, 7d50735705aa41008f11d35300f6987b, e02c4bc1a9024190bc54275a46c711b0; no voters:
I20260808 08:34:04.798350 10762 raft_consensus.cc:2781] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:04.798844 10762 raft_consensus.cc:686] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [term 1 LEADER]: Becoming Leader. State: Replica: 0b108e56f0f34869942b067168c56f25, State: Running, Role: LEADER
I20260808 08:34:04.799491 10762 consensus_queue.cc:237] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d50735705aa41008f11d35300f6987b" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 37979 } } peers { permanent_uuid: "e02c4bc1a9024190bc54275a46c711b0" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36677 } } peers { permanent_uuid: "0b108e56f0f34869942b067168c56f25" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44677 } }
I20260808 08:34:04.804710 10244 catalog_manager.cc:5495] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b108e56f0f34869942b067168c56f25 (127.5.164.193). New cstate: current_term: 1 leader_uuid: "0b108e56f0f34869942b067168c56f25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d50735705aa41008f11d35300f6987b" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 37979 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e02c4bc1a9024190bc54275a46c711b0" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b108e56f0f34869942b067168c56f25" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44677 } health_report { overall_health: HEALTHY } } }
I20260808 08:34:04.867033 10752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:04.861360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54966 (local address 127.5.164.193:44677)
0808 08:34:04.861594 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:04.861601 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:04.861706 (+ 105us) server_negotiation.cc:407] Connection header received
0808 08:34:04.861965 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:04.861970 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:04.862079 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:04.862249 (+ 170us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:04.862634 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.863456 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.864823 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.865238 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.865377 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:04.865867 (+ 490us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:04.866391 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:04.866585 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:04.866675 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 08:34:04.866761 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:34:04.875279 10540 raft_consensus.cc:1261] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b [term 1 FOLLOWER]: Refusing update from remote peer 0b108e56f0f34869942b067168c56f25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:04.875375 10683 raft_consensus.cc:1261] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0 [term 1 FOLLOWER]: Refusing update from remote peer 0b108e56f0f34869942b067168c56f25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:04.876375 10766 consensus_queue.cc:1035] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e02c4bc1a9024190bc54275a46c711b0" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:04.876741 10762 consensus_queue.cc:1035] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d50735705aa41008f11d35300f6987b" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 37979 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:04.908880 10244 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48228:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:34:04.909235 10244 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48228:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:34:04.913618 10244 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b638feba66444917b2d197b49723d700: Sending DeleteTablet for 3 replicas of tablet 9a9b1bf111264c81a58ae8fb7105e90a
I20260808 08:34:04.914923 10518 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a9b1bf111264c81a58ae8fb7105e90a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:04 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:42812
I20260808 08:34:04.914923 10662 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a9b1bf111264c81a58ae8fb7105e90a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:04 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:57294
I20260808 08:34:04.915989 10780 tablet_replica.cc:330] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0: stopping tablet replica
I20260808 08:34:04.916404 10781 tablet_replica.cc:330] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b: stopping tablet replica
I20260808 08:34:04.916476 10378 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a9b1bf111264c81a58ae8fb7105e90a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:04 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:54964
I20260808 08:34:04.916620 10780 raft_consensus.cc:2229] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:04.916921 10781 raft_consensus.cc:2229] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:04.917306 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 10312
I20260808 08:34:04.917387 10781 raft_consensus.cc:2258] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:04.917449 10780 raft_consensus.cc:2258] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:04.919862 10780 ts_tablet_manager.cc:1905] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:04.920176 10781 ts_tablet_manager.cc:1905] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:04.927418 10780 ts_tablet_manager.cc:1918] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:04.927441 10782 tablet_replica.cc:330] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25: stopping tablet replica
I20260808 08:34:04.927778 10780 log.cc:1196] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/9a9b1bf111264c81a58ae8fb7105e90a
I20260808 08:34:04.927459 10781 ts_tablet_manager.cc:1918] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:04.927953 10781 log.cc:1196] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/9a9b1bf111264c81a58ae8fb7105e90a
I20260808 08:34:04.928134 10782 raft_consensus.cc:2229] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:34:04.928553 10780 ts_tablet_manager.cc:1939] T 9a9b1bf111264c81a58ae8fb7105e90a P e02c4bc1a9024190bc54275a46c711b0: Deleting consensus metadata
I20260808 08:34:04.928544 10781 ts_tablet_manager.cc:1939] T 9a9b1bf111264c81a58ae8fb7105e90a P 7d50735705aa41008f11d35300f6987b: Deleting consensus metadata
I20260808 08:34:04.929101 10782 raft_consensus.cc:2258] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:04.930562 10229 catalog_manager.cc:4841] TS 7d50735705aa41008f11d35300f6987b (127.5.164.194:37979): tablet 9a9b1bf111264c81a58ae8fb7105e90a (table test-table [id=fb536bb2c35f4e37ba15cbb19ab7d4df]) successfully deleted
I20260808 08:34:04.930902 10231 catalog_manager.cc:4841] TS e02c4bc1a9024190bc54275a46c711b0 (127.5.164.195:36677): tablet 9a9b1bf111264c81a58ae8fb7105e90a (table test-table [id=fb536bb2c35f4e37ba15cbb19ab7d4df]) successfully deleted
I20260808 08:34:04.931879 10782 ts_tablet_manager.cc:1905] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:04.938406 10782 ts_tablet_manager.cc:1918] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:04.938598 10782 log.cc:1196] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/9a9b1bf111264c81a58ae8fb7105e90a
I20260808 08:34:04.939208 10782 ts_tablet_manager.cc:1939] T 9a9b1bf111264c81a58ae8fb7105e90a P 0b108e56f0f34869942b067168c56f25: Deleting consensus metadata
I20260808 08:34:04.940783 10229 catalog_manager.cc:4841] TS 0b108e56f0f34869942b067168c56f25 (127.5.164.193:44677): tablet 9a9b1bf111264c81a58ae8fb7105e90a (table test-table [id=fb536bb2c35f4e37ba15cbb19ab7d4df]) successfully deleted
Aug 08 08:34:04 dist-test-slave-chsk krb5kdc[10195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:34:04.949947 10752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:04.919594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54970 (local address 127.5.164.193:44677)
0808 08:34:04.919777 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:04.919784 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:04.931789 (+ 12005us) server_negotiation.cc:407] Connection header received
0808 08:34:04.931989 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:04.931996 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:04.932084 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:04.932200 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:04.933845 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.935119 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.936949 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:04.937674 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:04.937818 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:04.942786 (+ 4968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:04.942798 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:04.942812 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:04.942854 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:04.946757 (+ 3903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:04.947562 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:04.947572 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:04.947576 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:04.947748 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:04.948197 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:04.948203 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:04.948207 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:04.948665 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:04.949007 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:04.949286 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 08:34:04.949549 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:34:04.950695 10441 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:05.049873 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 10312
I20260808 08:34:05.069792 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 10453
Aug 08 08:34:05 dist-test-slave-chsk krb5kdc[10195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:34:05.084851 10749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:05.070541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42824 (local address 127.5.164.194:37979)
0808 08:34:05.070753 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:05.070758 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:05.070779 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:34:05.070978 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:05.070984 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:05.071068 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:05.071202 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:05.072438 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:05.073159 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:05.074353 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:05.074756 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:05.074908 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:05.079126 (+ 4218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:05.079182 (+ 56us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:05.079203 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:05.079247 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:05.081863 (+ 2616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:05.082556 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:05.082565 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:05.082569 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:05.082715 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:05.083110 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:05.083117 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:05.083120 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:05.083626 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:05.083943 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:05.084243 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 08:34:05.084469 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 08:34:05.085532 10582 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:05.177490 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 10453
I20260808 08:34:05.197816 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 10593
Aug 08 08:34:05 dist-test-slave-chsk krb5kdc[10195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:34:05.217284 10751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:05.198722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57306 (local address 127.5.164.195:36677)
0808 08:34:05.198934 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:05.198941 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:05.198965 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:34:05.199190 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:05.199196 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:05.199281 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:05.199388 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:05.200679 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:05.201410 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:05.202722 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:05.203189 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:05.203340 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:05.211737 (+ 8397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:05.211757 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:05.211774 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:05.211819 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:05.214534 (+ 2715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:05.215355 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:05.215364 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:05.215366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:05.215521 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:05.215931 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:05.215934 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:05.215937 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:05.216310 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:05.216535 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:05.216818 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 08:34:05.216989 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 08:34:05.217978 10727 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:05.307837 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 10593
I20260808 08:34:05.328630 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 10210
I20260808 08:34:05.329831 10277 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:05.440591 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 10210
2026-08-08T08:34:05Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4610 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T08:34:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:05Z Disabled control of system clock
I20260808 08:34:05.519975 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:39337
--webserver_interface=127.5.164.254
--webserver_port=0
--builtin_ntp_servers=127.5.164.212:43333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:39337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 08:34:05.868040 10792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:05.868358 10792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:05.868446 10792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:05.875887 10792 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:05.876006 10792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:05.876046 10792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:05.876102 10792 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:05.876154 10792 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:05.885457 10792 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:43333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:39337
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:39337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:05.886788 10792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:05.888638 10792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:05.900743 10803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:05.900835 10801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:05.900771 10799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:05.902179 10792 server_base.cc:1034] running on GCE node
I20260808 08:34:05.902977 10792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:05.904500 10792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:05.905717 10792 hybrid_clock.cc:648] HybridClock initialized: now 1786178045905657 us; error 57 us; skew 500 ppm
I20260808 08:34:05.906095 10792 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:34:05.908545 10792 webserver.cc:460] Webserver started at http://127.5.164.254:33571/ using document root <none> and password file <none>
I20260808 08:34:05.909294 10792 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:05.909412 10792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:05.909772 10792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:05.912904 10792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "fcebdfc512c24a4892eba360a90e1392"
format_stamp: "Formatted at 2026-08-08 08:34:05 on dist-test-slave-chsk"
server_key: "31b86f68f633495cd04e952860c64630"
server_key_iv: "b19fe71d137c0bc2e1ba1a53ce819d73"
server_key_version: "encryptionkey@0"
I20260808 08:34:05.913766 10792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "fcebdfc512c24a4892eba360a90e1392"
format_stamp: "Formatted at 2026-08-08 08:34:05 on dist-test-slave-chsk"
server_key: "31b86f68f633495cd04e952860c64630"
server_key_iv: "b19fe71d137c0bc2e1ba1a53ce819d73"
server_key_version: "encryptionkey@0"
I20260808 08:34:05.919291 10792 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260808 08:34:05.922981 10809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:05.924577 10792 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:05.924783 10792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "fcebdfc512c24a4892eba360a90e1392"
format_stamp: "Formatted at 2026-08-08 08:34:05 on dist-test-slave-chsk"
server_key: "31b86f68f633495cd04e952860c64630"
server_key_iv: "b19fe71d137c0bc2e1ba1a53ce819d73"
server_key_version: "encryptionkey@0"
I20260808 08:34:05.925042 10792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:05.931133 10792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:05.932134 10792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:05.932446 10792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:05.951819 10792 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:39337
I20260808 08:34:05.951869 10863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:39337 every 8 connection(s)
I20260808 08:34:05.953236 10792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:05.957059 10865 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:05.963119 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 10792
I20260808 08:34:05.963366 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:34:05.964257 5779 external_mini_cluster.cc:1428] Setting key 1b924542dc196376fa64bf024aec6c1a
I20260808 08:34:05.968848 10865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392: Bootstrap starting.
I20260808 08:34:05.972365 10865 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:05.973089 10868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:05.966604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57594 (local address 127.5.164.254:39337)
0808 08:34:05.967640 (+ 1036us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:05.967651 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:05.967692 (+ 41us) server_negotiation.cc:407] Connection header received
0808 08:34:05.969394 (+ 1702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:05.969417 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:05.969818 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:05.970212 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:05.971352 (+ 1140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:05.971357 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:05.971369 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:05.971383 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:05.971455 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:05.971472 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:05.971677 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:05.971823 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 08:34:05.972078 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":331,"threads_started":1}
I20260808 08:34:05.973538 10865 log.cc:824] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:05.976573 10865 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392: No bootstrap required, opened a new log
I20260808 08:34:05.984431 10865 raft_consensus.cc:348] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcebdfc512c24a4892eba360a90e1392" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39337 } }
I20260808 08:34:05.984812 10865 raft_consensus.cc:374] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:05.984917 10865 raft_consensus.cc:729] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcebdfc512c24a4892eba360a90e1392, State: Initialized, Role: FOLLOWER
I20260808 08:34:05.985438 10865 consensus_queue.cc:260] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcebdfc512c24a4892eba360a90e1392" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39337 } }
I20260808 08:34:05.985741 10865 raft_consensus.cc:388] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:05.985881 10865 raft_consensus.cc:482] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:05.986083 10865 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:05.988387 10865 raft_consensus.cc:504] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcebdfc512c24a4892eba360a90e1392" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39337 } }
I20260808 08:34:05.988941 10865 leader_election.cc:302] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fcebdfc512c24a4892eba360a90e1392; no voters:
I20260808 08:34:05.989573 10865 leader_election.cc:288] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:05.989722 10870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:05.991276 10870 raft_consensus.cc:686] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [term 1 LEADER]: Becoming Leader. State: Replica: fcebdfc512c24a4892eba360a90e1392, State: Running, Role: LEADER
I20260808 08:34:05.991860 10865 sys_catalog.cc:564] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:05.991852 10870 consensus_queue.cc:237] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcebdfc512c24a4892eba360a90e1392" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39337 } }
I20260808 08:34:05.994771 10872 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fcebdfc512c24a4892eba360a90e1392. Latest consensus state: current_term: 1 leader_uuid: "fcebdfc512c24a4892eba360a90e1392" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcebdfc512c24a4892eba360a90e1392" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39337 } } }
I20260808 08:34:05.995167 10872 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:05.995827 10871 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fcebdfc512c24a4892eba360a90e1392" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcebdfc512c24a4892eba360a90e1392" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39337 } } }
I20260808 08:34:05.996145 10879 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:05.996176 10871 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:06.005821 10879 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:06.014595 10879 catalog_manager.cc:1347] Generated new cluster ID: 53ad87a010f04506b6157db840b06ef3
I20260808 08:34:06.014740 10879 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:06.036957 10879 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:06.037513 10879 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:06.052608 10879 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392: Generated new TSK 0
I20260808 08:34:06.053743 10879 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:06.060688 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39337
--builtin_ntp_servers=127.5.164.212:43333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 08:34:06.401250 10891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:06.401592 10891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:06.401764 10891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:06.409148 10891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:06.409322 10891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:06.409514 10891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:34:06.418911 10891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:43333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39337
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:06.420414 10891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:06.422372 10891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:06.436650 10901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:06.436712 10898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:06.436736 10897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:06.438320 10891 server_base.cc:1034] running on GCE node
I20260808 08:34:06.438930 10891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:06.439961 10891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:06.441176 10891 hybrid_clock.cc:648] HybridClock initialized: now 1786178046441134 us; error 39 us; skew 500 ppm
I20260808 08:34:06.441522 10891 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:34:06.444046 10891 webserver.cc:460] Webserver started at http://127.5.164.193:38791/ using document root <none> and password file <none>
I20260808 08:34:06.444805 10891 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:06.444923 10891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:06.445310 10891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:06.448489 10891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "d119e0a9cc7a417ba7df04e7059d270c"
format_stamp: "Formatted at 2026-08-08 08:34:06 on dist-test-slave-chsk"
server_key: "281f56201c8cd9803b17dfb1dc8caa40"
server_key_iv: "095acc2e5748699f7e609d79c0d1c4b8"
server_key_version: "encryptionkey@0"
I20260808 08:34:06.449271 10891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "d119e0a9cc7a417ba7df04e7059d270c"
format_stamp: "Formatted at 2026-08-08 08:34:06 on dist-test-slave-chsk"
server_key: "281f56201c8cd9803b17dfb1dc8caa40"
server_key_iv: "095acc2e5748699f7e609d79c0d1c4b8"
server_key_version: "encryptionkey@0"
I20260808 08:34:06.454905 10891 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260808 08:34:06.458477 10908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:06.459909 10891 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:06.460112 10891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "d119e0a9cc7a417ba7df04e7059d270c"
format_stamp: "Formatted at 2026-08-08 08:34:06 on dist-test-slave-chsk"
server_key: "281f56201c8cd9803b17dfb1dc8caa40"
server_key_iv: "095acc2e5748699f7e609d79c0d1c4b8"
server_key_version: "encryptionkey@0"
I20260808 08:34:06.460362 10891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:06.466164 10891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:06.466984 10891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:06.467329 10891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:06.468248 10891 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:06.469709 10891 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:06.469825 10891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:06.469955 10891 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:06.470067 10891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:06.504669 10891 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:39685
I20260808 08:34:06.504763 11027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:39685 every 8 connection(s)
I20260808 08:34:06.506067 10891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:34:06.506589 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 10891
I20260808 08:34:06.506822 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:34:06.507682 5779 external_mini_cluster.cc:1428] Setting key 02357c0a36a6f3aa113df59bf6a6806a
I20260808 08:34:06.511183 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39337
--builtin_ntp_servers=127.5.164.212:43333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 08:34:06.516301 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:06.509041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:33115 (local address 127.5.164.254:39337)
0808 08:34:06.509559 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:06.509567 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:06.511070 (+ 1503us) server_negotiation.cc:407] Connection header received
0808 08:34:06.513865 (+ 2795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:06.513869 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:06.513922 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:06.514015 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:06.515562 (+ 1547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:06.515567 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:06.515570 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:06.515588 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:06.515645 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:06.515658 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:06.515767 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:06.515995 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 08:34:06.516055 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":258,"threads_started":1}
I20260808 08:34:06.517617 11033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:06.509675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39337 (local address 127.5.164.193:33115)
0808 08:34:06.510893 (+ 1218us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:06.510943 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:06.513582 (+ 2639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:06.514287 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:06.514301 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:06.514423 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:06.515162 (+ 739us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:34:06.515167 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:06.515230 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:34:06.515346 (+ 116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:06.515768 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:06.515781 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:06.515791 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 08:34:06.516068 (+ 277us) client_negotiation.cc:240] Negotiation successful
0808 08:34:06.516341 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":391,"threads_started":1}
I20260808 08:34:06.519444 11028 heartbeater.cc:347] Connected to a master server at 127.5.164.254:39337
I20260808 08:34:06.519786 11028 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:06.520413 11028 heartbeater.cc:511] Master 127.5.164.254:39337 requested a full tablet report, sending...
I20260808 08:34:06.522442 10828 ts_manager.cc:194] Registered new tserver with Master: d119e0a9cc7a417ba7df04e7059d270c (127.5.164.193:39685)
W20260808 08:34:06.841524 11035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:06.841845 11035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:06.842037 11035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:06.849373 11035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:06.849512 11035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:06.849702 11035 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:34:06.860062 11035 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:43333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39337
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:06.861514 11035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:06.863466 11035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:06.877194 11042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:06.877162 11044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:06.877271 11041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:06.880544 11035 server_base.cc:1034] running on GCE node
I20260808 08:34:06.881163 11035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:06.882128 11035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:06.883355 11035 hybrid_clock.cc:648] HybridClock initialized: now 1786178046883314 us; error 52 us; skew 500 ppm
I20260808 08:34:06.883680 11035 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:34:06.885913 11035 webserver.cc:460] Webserver started at http://127.5.164.194:43079/ using document root <none> and password file <none>
I20260808 08:34:06.886606 11035 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:06.886751 11035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:06.887084 11035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:06.890122 11035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "456d49c70a2c4efb86750430b0b42a1e"
format_stamp: "Formatted at 2026-08-08 08:34:06 on dist-test-slave-chsk"
server_key: "973b49de993d8e0baec741d51f58e72c"
server_key_iv: "21b95a0d7ba77901f652c2dc98c4c401"
server_key_version: "encryptionkey@0"
I20260808 08:34:06.890944 11035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "456d49c70a2c4efb86750430b0b42a1e"
format_stamp: "Formatted at 2026-08-08 08:34:06 on dist-test-slave-chsk"
server_key: "973b49de993d8e0baec741d51f58e72c"
server_key_iv: "21b95a0d7ba77901f652c2dc98c4c401"
server_key_version: "encryptionkey@0"
I20260808 08:34:06.896551 11035 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 08:34:06.900247 11051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:06.901592 11035 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:34:06.901732 11035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "456d49c70a2c4efb86750430b0b42a1e"
format_stamp: "Formatted at 2026-08-08 08:34:06 on dist-test-slave-chsk"
server_key: "973b49de993d8e0baec741d51f58e72c"
server_key_iv: "21b95a0d7ba77901f652c2dc98c4c401"
server_key_version: "encryptionkey@0"
I20260808 08:34:06.901932 11035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:06.907783 11035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:06.908540 11035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:06.908787 11035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:06.909741 11035 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:06.911300 11035 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:06.911391 11035 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:06.911473 11035 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:06.911541 11035 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:06.946738 11035 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:38733
I20260808 08:34:06.946821 11172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:38733 every 8 connection(s)
I20260808 08:34:06.948302 11035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:34:06.952149 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 11035
I20260808 08:34:06.952334 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:34:06.952939 5779 external_mini_cluster.cc:1428] Setting key bd1163f4b317a42184ed6bff3572cd06
I20260808 08:34:06.955868 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39337
--builtin_ntp_servers=127.5.164.212:43333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 08:34:06.958091 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:06.950963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:49787 (local address 127.5.164.254:39337)
0808 08:34:06.951248 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:06.951255 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:06.952911 (+ 1656us) server_negotiation.cc:407] Connection header received
0808 08:34:06.955338 (+ 2427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:06.955344 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:06.955408 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:06.955523 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:06.957173 (+ 1650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:06.957181 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:06.957189 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:06.957213 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:06.957264 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:06.957284 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:06.957423 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:06.957636 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 08:34:06.957726 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 08:34:06.959084 11176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:06.951537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39337 (local address 127.5.164.194:49787)
0808 08:34:06.952731 (+ 1194us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:06.952793 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:06.954998 (+ 2205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:06.955776 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:06.955787 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:06.955908 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:06.956777 (+ 869us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:34:06.956780 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:06.956832 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:34:06.956953 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:06.957399 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:06.957408 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:06.957416 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 08:34:06.957707 (+ 291us) client_negotiation.cc:240] Negotiation successful
0808 08:34:06.957954 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":383,"threads_started":1}
I20260808 08:34:06.960557 11173 heartbeater.cc:347] Connected to a master server at 127.5.164.254:39337
I20260808 08:34:06.960884 11173 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:06.961629 11173 heartbeater.cc:511] Master 127.5.164.254:39337 requested a full tablet report, sending...
I20260808 08:34:06.963304 10828 ts_manager.cc:194] Registered new tserver with Master: 456d49c70a2c4efb86750430b0b42a1e (127.5.164.194:38733)
W20260808 08:34:07.292703 11177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:07.293148 11177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:07.293354 11177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:07.301254 11177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:07.301362 11177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:07.301551 11177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:34:07.311058 11177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:43333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39337
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:07.312415 11177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:07.314267 11177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:07.327868 11183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:07.327930 11184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:07.327807 11186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:07.328675 11177 server_base.cc:1034] running on GCE node
I20260808 08:34:07.329372 11177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:07.330314 11177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:07.331538 11177 hybrid_clock.cc:648] HybridClock initialized: now 1786178047331485 us; error 35 us; skew 500 ppm
I20260808 08:34:07.331887 11177 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:34:07.334318 11177 webserver.cc:460] Webserver started at http://127.5.164.195:42603/ using document root <none> and password file <none>
I20260808 08:34:07.335065 11177 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:07.335225 11177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:07.335561 11177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:07.338589 11177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "5e4a0aac91ca484ebbfbfe334b204d60"
format_stamp: "Formatted at 2026-08-08 08:34:07 on dist-test-slave-chsk"
server_key: "fab98837871fe739be275ee446c3d66c"
server_key_iv: "80a77228595b592c15cddb1d8ef79504"
server_key_version: "encryptionkey@0"
I20260808 08:34:07.339443 11177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "5e4a0aac91ca484ebbfbfe334b204d60"
format_stamp: "Formatted at 2026-08-08 08:34:07 on dist-test-slave-chsk"
server_key: "fab98837871fe739be275ee446c3d66c"
server_key_iv: "80a77228595b592c15cddb1d8ef79504"
server_key_version: "encryptionkey@0"
I20260808 08:34:07.344830 11177 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:34:07.348479 11195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:07.349799 11177 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 08:34:07.350016 11177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "5e4a0aac91ca484ebbfbfe334b204d60"
format_stamp: "Formatted at 2026-08-08 08:34:07 on dist-test-slave-chsk"
server_key: "fab98837871fe739be275ee446c3d66c"
server_key_iv: "80a77228595b592c15cddb1d8ef79504"
server_key_version: "encryptionkey@0"
I20260808 08:34:07.350272 11177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:07.356367 11177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:07.357197 11177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:07.357494 11177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:07.358457 11177 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:07.360018 11177 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:07.360148 11177 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:07.360296 11177 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:07.360404 11177 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:07.396373 11177 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:41933
I20260808 08:34:07.396428 11314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:41933 every 8 connection(s)
I20260808 08:34:07.397816 11177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:34:07.403852 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 11177
I20260808 08:34:07.404042 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:34:07.404703 5779 external_mini_cluster.cc:1428] Setting key d093a21dad35cd13940d74ce6ce9fc46
I20260808 08:34:07.407371 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.400529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:36325 (local address 127.5.164.254:39337)
0808 08:34:07.400725 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:07.400730 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:07.402171 (+ 1441us) server_negotiation.cc:407] Connection header received
0808 08:34:07.404496 (+ 2325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:07.404501 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:07.404556 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:07.404652 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:07.406435 (+ 1783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:07.406441 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:07.406446 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:07.406471 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:07.406530 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:07.406548 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:07.406694 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:07.406921 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 08:34:07.407013 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:34:07.408368 11317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.401037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39337 (local address 127.5.164.195:36325)
0808 08:34:07.401999 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:07.402051 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:07.404187 (+ 2136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:07.404960 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:07.404972 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:07.405196 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:07.406033 (+ 837us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:34:07.406037 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:07.406071 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:34:07.406155 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:07.406670 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:07.406682 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:07.406689 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 08:34:07.406996 (+ 307us) client_negotiation.cc:240] Negotiation successful
0808 08:34:07.407293 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":307,"threads_started":1}
I20260808 08:34:07.409607 11315 heartbeater.cc:347] Connected to a master server at 127.5.164.254:39337
I20260808 08:34:07.409842 11315 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:07.410338 11315 heartbeater.cc:511] Master 127.5.164.254:39337 requested a full tablet report, sending...
I20260808 08:34:07.411623 10828 ts_manager.cc:194] Registered new tserver with Master: 5e4a0aac91ca484ebbfbfe334b204d60 (127.5.164.195:41933)
I20260808 08:34:07.420691 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:34:07.427807 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.425062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52042 (local address 127.5.164.254:39337)
0808 08:34:07.425243 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:07.425247 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:07.425769 (+ 522us) server_negotiation.cc:407] Connection header received
0808 08:34:07.425953 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:07.425959 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:07.426022 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:07.426123 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:07.427083 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:07.427089 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:07.427094 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:07.427111 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:07.427214 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:07.427231 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:07.427368 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:07.427488 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 08:34:07.427549 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:34:07.431880 10828 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52042:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:34:07.438570 10828 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:34:07.456261 11327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.450566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:41933 (local address 127.0.0.1:33260)
0808 08:34:07.451669 (+ 1103us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:07.451700 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:07.451802 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:07.452799 (+ 997us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:07.452806 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:07.452897 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:07.454733 (+ 1836us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:34:07.454737 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:07.454771 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:34:07.454850 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:07.455521 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:07.455531 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:07.455541 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 08:34:07.455767 (+ 226us) client_negotiation.cc:240] Negotiation successful
0808 08:34:07.455856 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":911,"thread_start_us":772,"threads_started":1}
I20260808 08:34:07.456288 11328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.450847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33260 (local address 127.5.164.195:41933)
0808 08:34:07.452341 (+ 1494us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:07.452350 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:07.452386 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:34:07.452456 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:07.452462 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:07.452620 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:07.452781 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:07.455013 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:07.455025 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:07.455043 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:07.455063 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:07.455122 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:07.455186 (+ 64us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:07.455423 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:07.455760 (+ 337us) server_negotiation.cc:299] Negotiation successful
0808 08:34:07.455867 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1296,"thread_start_us":1120,"threads_started":1}
I20260808 08:34:07.460256 11327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.457019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:39685 (local address 127.0.0.1:46946)
0808 08:34:07.458155 (+ 1136us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:07.458180 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:07.458265 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:07.458735 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:07.458740 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:07.458776 (+ 36us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:07.459333 (+ 557us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:34:07.459336 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:07.459352 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:34:07.459394 (+ 42us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:07.459829 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:07.459834 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:07.459839 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:34:07.459946 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 08:34:07.459993 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":715}
I20260808 08:34:07.460326 11329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.452247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:38733 (local address 127.0.0.1:60102)
0808 08:34:07.455847 (+ 3600us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:07.455863 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:07.455953 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:07.457521 (+ 1568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:07.457525 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:07.457549 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:07.458226 (+ 677us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:34:07.458229 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:07.458245 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:34:07.458283 (+ 38us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:07.459021 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:07.459025 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:07.459030 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:34:07.459226 (+ 196us) client_negotiation.cc:240] Negotiation successful
0808 08:34:07.459530 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3462,"thread_start_us":2845,"threads_started":1}
I20260808 08:34:07.460383 11330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.452726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60102 (local address 127.5.164.194:38733)
0808 08:34:07.455575 (+ 2849us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:07.455583 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:07.456074 (+ 491us) server_negotiation.cc:407] Connection header received
0808 08:34:07.456163 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:07.456171 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:07.456370 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:07.456516 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:07.458437 (+ 1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:07.458443 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:07.458452 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:07.458502 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:07.458561 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:07.458587 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:07.458764 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:07.459948 (+ 1184us) server_negotiation.cc:299] Negotiation successful
0808 08:34:07.460062 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2683,"thread_start_us":2532,"threads_started":1}
I20260808 08:34:07.461199 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.456082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46946 (local address 127.5.164.193:39685)
0808 08:34:07.457849 (+ 1767us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:07.457857 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:07.458290 (+ 433us) server_negotiation.cc:407] Connection header received
0808 08:34:07.458373 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:07.458383 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:07.458572 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:07.458738 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:07.459587 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:07.459594 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:07.459606 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:07.459625 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:07.459679 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:07.459702 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:07.459839 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:07.460738 (+ 899us) server_negotiation.cc:299] Negotiation successful
0808 08:34:07.460846 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1617,"thread_start_us":1501,"threads_started":1}
I20260808 08:34:07.461400 11245 tablet_service.cc:1467] Processing CreateTablet for tablet 5f797f3396884598a85f407e37c3d71d (DEFAULT_TABLE table=test-table [id=2e643939a73144b1aff7f1619c47e32d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:07.463027 11245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f797f3396884598a85f407e37c3d71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:07.463927 11104 tablet_service.cc:1467] Processing CreateTablet for tablet 5f797f3396884598a85f407e37c3d71d (DEFAULT_TABLE table=test-table [id=2e643939a73144b1aff7f1619c47e32d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:07.464107 10959 tablet_service.cc:1467] Processing CreateTablet for tablet 5f797f3396884598a85f407e37c3d71d (DEFAULT_TABLE table=test-table [id=2e643939a73144b1aff7f1619c47e32d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:07.465214 11104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f797f3396884598a85f407e37c3d71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:07.465378 10959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f797f3396884598a85f407e37c3d71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:07.476145 11332 tablet_bootstrap.cc:492] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c: Bootstrap starting.
I20260808 08:34:07.478055 11333 tablet_bootstrap.cc:492] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60: Bootstrap starting.
I20260808 08:34:07.480131 11332 tablet_bootstrap.cc:654] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:07.481441 11332 log.cc:824] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:07.481778 11333 tablet_bootstrap.cc:654] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:07.483042 11333 log.cc:824] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:07.483878 11334 tablet_bootstrap.cc:492] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e: Bootstrap starting.
I20260808 08:34:07.484807 11332 tablet_bootstrap.cc:492] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c: No bootstrap required, opened a new log
I20260808 08:34:07.485078 11332 ts_tablet_manager.cc:1397] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 08:34:07.485777 11333 tablet_bootstrap.cc:492] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60: No bootstrap required, opened a new log
I20260808 08:34:07.486052 11333 ts_tablet_manager.cc:1397] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260808 08:34:07.487385 11334 tablet_bootstrap.cc:654] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:07.488509 11334 log.cc:824] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:07.491398 11334 tablet_bootstrap.cc:492] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e: No bootstrap required, opened a new log
I20260808 08:34:07.491667 11334 ts_tablet_manager.cc:1397] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20260808 08:34:07.493975 11333 raft_consensus.cc:348] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4a0aac91ca484ebbfbfe334b204d60" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41933 } } peers { permanent_uuid: "456d49c70a2c4efb86750430b0b42a1e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38733 } } peers { permanent_uuid: "d119e0a9cc7a417ba7df04e7059d270c" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 39685 } }
I20260808 08:34:07.494323 11333 raft_consensus.cc:374] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:07.494455 11333 raft_consensus.cc:729] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e4a0aac91ca484ebbfbfe334b204d60, State: Initialized, Role: FOLLOWER
I20260808 08:34:07.495064 11333 consensus_queue.cc:260] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4a0aac91ca484ebbfbfe334b204d60" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41933 } } peers { permanent_uuid: "456d49c70a2c4efb86750430b0b42a1e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38733 } } peers { permanent_uuid: "d119e0a9cc7a417ba7df04e7059d270c" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 39685 } }
I20260808 08:34:07.495339 11332 raft_consensus.cc:348] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4a0aac91ca484ebbfbfe334b204d60" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41933 } } peers { permanent_uuid: "456d49c70a2c4efb86750430b0b42a1e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38733 } } peers { permanent_uuid: "d119e0a9cc7a417ba7df04e7059d270c" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 39685 } }
I20260808 08:34:07.495817 11332 raft_consensus.cc:374] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:07.495952 11332 raft_consensus.cc:729] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d119e0a9cc7a417ba7df04e7059d270c, State: Initialized, Role: FOLLOWER
I20260808 08:34:07.496287 11315 heartbeater.cc:503] Master 127.5.164.254:39337 was elected leader, sending a full tablet report...
I20260808 08:34:07.496589 11332 consensus_queue.cc:260] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4a0aac91ca484ebbfbfe334b204d60" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41933 } } peers { permanent_uuid: "456d49c70a2c4efb86750430b0b42a1e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38733 } } peers { permanent_uuid: "d119e0a9cc7a417ba7df04e7059d270c" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 39685 } }
I20260808 08:34:07.496883 11333 ts_tablet_manager.cc:1428] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260808 08:34:07.503965 11334 raft_consensus.cc:348] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4a0aac91ca484ebbfbfe334b204d60" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41933 } } peers { permanent_uuid: "456d49c70a2c4efb86750430b0b42a1e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38733 } } peers { permanent_uuid: "d119e0a9cc7a417ba7df04e7059d270c" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 39685 } }
I20260808 08:34:07.504505 11334 raft_consensus.cc:374] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:07.504623 11334 raft_consensus.cc:729] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 456d49c70a2c4efb86750430b0b42a1e, State: Initialized, Role: FOLLOWER
I20260808 08:34:07.505314 11334 consensus_queue.cc:260] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4a0aac91ca484ebbfbfe334b204d60" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41933 } } peers { permanent_uuid: "456d49c70a2c4efb86750430b0b42a1e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38733 } } peers { permanent_uuid: "d119e0a9cc7a417ba7df04e7059d270c" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 39685 } }
I20260808 08:34:07.506487 11173 heartbeater.cc:503] Master 127.5.164.254:39337 was elected leader, sending a full tablet report...
I20260808 08:34:07.507261 11332 ts_tablet_manager.cc:1428] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c: Time spent starting tablet: real 0.022s user 0.018s sys 0.005s
I20260808 08:34:07.507813 11028 heartbeater.cc:503] Master 127.5.164.254:39337 was elected leader, sending a full tablet report...
I20260808 08:34:07.508556 11334 ts_tablet_manager.cc:1428] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e: Time spent starting tablet: real 0.017s user 0.015s sys 0.000s
W20260808 08:34:07.509083 11029 tablet.cc:2369] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:34:07.642012 11341 raft_consensus.cc:482] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:34:07.642401 11341 raft_consensus.cc:504] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4a0aac91ca484ebbfbfe334b204d60" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41933 } } peers { permanent_uuid: "456d49c70a2c4efb86750430b0b42a1e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38733 } } peers { permanent_uuid: "d119e0a9cc7a417ba7df04e7059d270c" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 39685 } }
I20260808 08:34:07.644302 11341 leader_election.cc:288] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e4a0aac91ca484ebbfbfe334b204d60 (127.5.164.195:41933), 456d49c70a2c4efb86750430b0b42a1e (127.5.164.194:38733)
I20260808 08:34:07.647836 11328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.644665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:49459 (local address 127.5.164.195:41933)
0808 08:34:07.644855 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:07.644860 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:07.645471 (+ 611us) server_negotiation.cc:407] Connection header received
0808 08:34:07.645669 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:07.645678 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:07.645754 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:07.645832 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:07.647111 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:07.647116 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:07.647119 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:07.647185 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:07.647230 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:07.647245 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:07.647381 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:07.647461 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 08:34:07.647530 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:34:07.648015 11343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.644703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:41933 (local address 127.5.164.193:49459)
0808 08:34:07.645302 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:07.645319 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:07.645483 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:07.646032 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:07.646035 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:07.646054 (+ 19us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:07.646903 (+ 849us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:34:07.646905 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:07.646920 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:34:07.646957 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:07.647343 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:07.647348 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:07.647352 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 08:34:07.647494 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 08:34:07.647545 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":313,"threads_started":1}
I20260808 08:34:07.648156 11330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.645642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:33569 (local address 127.5.164.194:38733)
0808 08:34:07.645843 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:07.645848 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:07.646199 (+ 351us) server_negotiation.cc:407] Connection header received
0808 08:34:07.646289 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:07.646296 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:07.646365 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:07.646480 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:07.647490 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:07.647496 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:07.647501 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:07.647527 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:07.647558 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:07.647569 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:07.647712 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:07.647799 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 08:34:07.647869 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:34:07.648468 11344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.645447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:38733 (local address 127.5.164.193:33569)
0808 08:34:07.646072 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:07.646091 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:07.646193 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:07.646552 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:07.646557 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:07.646581 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:07.647278 (+ 697us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:34:07.647280 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:07.647295 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:34:07.647331 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:07.647680 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:07.647686 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:07.647692 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 08:34:07.647852 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 08:34:07.647910 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":328,"threads_started":1}
I20260808 08:34:07.649380 11126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f797f3396884598a85f407e37c3d71d" candidate_uuid: "d119e0a9cc7a417ba7df04e7059d270c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "456d49c70a2c4efb86750430b0b42a1e" is_pre_election: true
I20260808 08:34:07.649380 11268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f797f3396884598a85f407e37c3d71d" candidate_uuid: "d119e0a9cc7a417ba7df04e7059d270c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e4a0aac91ca484ebbfbfe334b204d60" is_pre_election: true
W20260808 08:34:07.649793 11316 tablet.cc:2369] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:34:07.649957 11126 raft_consensus.cc:2454] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d119e0a9cc7a417ba7df04e7059d270c in term 0.
I20260808 08:34:07.650013 11268 raft_consensus.cc:2454] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d119e0a9cc7a417ba7df04e7059d270c in term 0.
I20260808 08:34:07.650667 10910 leader_election.cc:302] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 456d49c70a2c4efb86750430b0b42a1e, d119e0a9cc7a417ba7df04e7059d270c; no voters:
I20260808 08:34:07.651008 11341 raft_consensus.cc:2781] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:34:07.651191 11341 raft_consensus.cc:482] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:34:07.651315 11341 raft_consensus.cc:3037] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:07.653529 11341 raft_consensus.cc:504] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4a0aac91ca484ebbfbfe334b204d60" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41933 } } peers { permanent_uuid: "456d49c70a2c4efb86750430b0b42a1e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38733 } } peers { permanent_uuid: "d119e0a9cc7a417ba7df04e7059d270c" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 39685 } }
I20260808 08:34:07.654171 11341 leader_election.cc:288] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [CANDIDATE]: Term 1 election: Requested vote from peers 5e4a0aac91ca484ebbfbfe334b204d60 (127.5.164.195:41933), 456d49c70a2c4efb86750430b0b42a1e (127.5.164.194:38733)
I20260808 08:34:07.654644 11268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f797f3396884598a85f407e37c3d71d" candidate_uuid: "d119e0a9cc7a417ba7df04e7059d270c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e4a0aac91ca484ebbfbfe334b204d60"
I20260808 08:34:07.654683 11126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f797f3396884598a85f407e37c3d71d" candidate_uuid: "d119e0a9cc7a417ba7df04e7059d270c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "456d49c70a2c4efb86750430b0b42a1e"
I20260808 08:34:07.654848 11268 raft_consensus.cc:3037] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:07.654881 11126 raft_consensus.cc:3037] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:07.657215 11268 raft_consensus.cc:2454] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d119e0a9cc7a417ba7df04e7059d270c in term 1.
I20260808 08:34:07.657222 11126 raft_consensus.cc:2454] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d119e0a9cc7a417ba7df04e7059d270c in term 1.
I20260808 08:34:07.657604 10910 leader_election.cc:302] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e4a0aac91ca484ebbfbfe334b204d60, d119e0a9cc7a417ba7df04e7059d270c; no voters:
I20260808 08:34:07.657948 11341 raft_consensus.cc:2781] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:07.658402 11341 raft_consensus.cc:686] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [term 1 LEADER]: Becoming Leader. State: Replica: d119e0a9cc7a417ba7df04e7059d270c, State: Running, Role: LEADER
I20260808 08:34:07.658886 11341 consensus_queue.cc:237] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4a0aac91ca484ebbfbfe334b204d60" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41933 } } peers { permanent_uuid: "456d49c70a2c4efb86750430b0b42a1e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38733 } } peers { permanent_uuid: "d119e0a9cc7a417ba7df04e7059d270c" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 39685 } }
I20260808 08:34:07.663261 10827 catalog_manager.cc:5495] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c reported cstate change: term changed from 0 to 1, leader changed from <none> to d119e0a9cc7a417ba7df04e7059d270c (127.5.164.193). New cstate: current_term: 1 leader_uuid: "d119e0a9cc7a417ba7df04e7059d270c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e4a0aac91ca484ebbfbfe334b204d60" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "456d49c70a2c4efb86750430b0b42a1e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d119e0a9cc7a417ba7df04e7059d270c" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 39685 } health_report { overall_health: HEALTHY } } }
I20260808 08:34:07.695230 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.693269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46956 (local address 127.5.164.193:39685)
0808 08:34:07.693439 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:07.693444 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:07.693463 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:34:07.693558 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:07.693562 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:07.693644 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:07.693737 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:07.694627 (+ 890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:07.694632 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:07.694635 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:07.694652 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:07.694684 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:07.694696 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:07.694797 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:07.694890 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 08:34:07.694937 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260808 08:34:07.700525 11174 tablet.cc:2369] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:34:07.703538 11126 raft_consensus.cc:1261] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e [term 1 FOLLOWER]: Refusing update from remote peer d119e0a9cc7a417ba7df04e7059d270c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:07.703658 11268 raft_consensus.cc:1261] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60 [term 1 FOLLOWER]: Refusing update from remote peer d119e0a9cc7a417ba7df04e7059d270c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:07.704541 11341 consensus_queue.cc:1035] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [LEADER]: Connected to new peer: Peer: permanent_uuid: "456d49c70a2c4efb86750430b0b42a1e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:07.704892 11345 consensus_queue.cc:1035] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e4a0aac91ca484ebbfbfe334b204d60" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:07.718312 11349 mvcc.cc:205] Tried to move back new op lower bound from 7316185283383398400 to 7316185283215056896. Current Snapshot: MvccSnapshot[applied={T|T < 7316185283383398400}]
I20260808 08:34:07.731822 10828 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:34:07.732452 10828 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52042:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:34:07.737085 10828 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fcebdfc512c24a4892eba360a90e1392: Sending DeleteTablet for 3 replicas of tablet 5f797f3396884598a85f407e37c3d71d
I20260808 08:34:07.738300 11245 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f797f3396884598a85f407e37c3d71d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:07 UTC) from {username='slave'} at 127.0.0.1:33260
I20260808 08:34:07.738468 11104 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f797f3396884598a85f407e37c3d71d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:07 UTC) from {username='slave'} at 127.0.0.1:60102
I20260808 08:34:07.738729 10959 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f797f3396884598a85f407e37c3d71d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:07 UTC) from {username='slave'} at 127.0.0.1:46946
I20260808 08:34:07.739702 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 10891
I20260808 08:34:07.745163 11331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.741353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46960 (local address 127.5.164.193:39685)
0808 08:34:07.741573 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:07.741582 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:07.742254 (+ 672us) server_negotiation.cc:407] Connection header received
0808 08:34:07.742592 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:07.742601 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:07.742683 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:07.742774 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:07.744283 (+ 1509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:07.744288 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:07.744292 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:07.744312 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:07.744349 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:07.744364 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:07.744463 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:07.744746 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 08:34:07.744822 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:34:07.746359 11023 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:07.750530 11360 tablet_replica.cc:330] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e: stopping tablet replica
I20260808 08:34:07.751113 11360 raft_consensus.cc:2229] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:07.751775 11360 raft_consensus.cc:2258] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:07.752763 11359 tablet_replica.cc:330] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60: stopping tablet replica
I20260808 08:34:07.753324 11359 raft_consensus.cc:2229] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:07.753859 11359 raft_consensus.cc:2258] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:07.754884 11360 ts_tablet_manager.cc:1905] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:07.756789 11359 ts_tablet_manager.cc:1905] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:07.760509 11360 ts_tablet_manager.cc:1918] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:07.760685 11360 log.cc:1196] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/5f797f3396884598a85f407e37c3d71d
I20260808 08:34:07.761148 11360 ts_tablet_manager.cc:1939] T 5f797f3396884598a85f407e37c3d71d P 456d49c70a2c4efb86750430b0b42a1e: Deleting consensus metadata
I20260808 08:34:07.762708 10811 catalog_manager.cc:4841] TS 456d49c70a2c4efb86750430b0b42a1e (127.5.164.194:38733): tablet 5f797f3396884598a85f407e37c3d71d (table test-table [id=2e643939a73144b1aff7f1619c47e32d]) successfully deleted
I20260808 08:34:07.764161 11359 ts_tablet_manager.cc:1918] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:07.764351 11359 log.cc:1196] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/5f797f3396884598a85f407e37c3d71d
I20260808 08:34:07.764943 11359 ts_tablet_manager.cc:1939] T 5f797f3396884598a85f407e37c3d71d P 5e4a0aac91ca484ebbfbfe334b204d60: Deleting consensus metadata
I20260808 08:34:07.766860 10811 catalog_manager.cc:4841] TS 5e4a0aac91ca484ebbfbfe334b204d60 (127.5.164.195:41933): tablet 5f797f3396884598a85f407e37c3d71d (table test-table [id=2e643939a73144b1aff7f1619c47e32d]) successfully deleted
I20260808 08:34:07.849951 11361 tablet_replica.cc:330] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c: stopping tablet replica
I20260808 08:34:07.850497 11361 raft_consensus.cc:2229] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:34:07.851305 11361 raft_consensus.cc:2258] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:07.853484 11361 ts_tablet_manager.cc:1905] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:07.859129 11361 ts_tablet_manager.cc:1918] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:07.859380 11361 log.cc:1196] T 5f797f3396884598a85f407e37c3d71d P d119e0a9cc7a417ba7df04e7059d270c: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/5f797f3396884598a85f407e37c3d71d
I20260808 08:34:07.859597 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 10891
W20260808 08:34:07.881397 10811 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.164.193:39685 (error 108)
I20260808 08:34:07.881670 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 11035
I20260808 08:34:07.883687 11329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.883061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:39685 (local address 127.0.0.1:46966)
0808 08:34:07.883282 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:07.883490 (+ 208us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:39685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 08:34:07.883937 10811 catalog_manager.cc:4584] TS d119e0a9cc7a417ba7df04e7059d270c (127.5.164.193:39685): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5f797f3396884598a85f407e37c3d71d: Network error: Client connection negotiation failed: client connection to 127.5.164.193:39685: connect: Connection refused (error 111)
I20260808 08:34:07.885001 11330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.882666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60118 (local address 127.5.164.194:38733)
0808 08:34:07.882860 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:07.882869 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:07.882892 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:34:07.883090 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:07.883095 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:07.883250 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:07.883398 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:07.884363 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:07.884367 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:07.884370 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:07.884384 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:07.884415 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:07.884426 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:07.884524 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:07.884641 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 08:34:07.884688 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:34:07.885733 11168 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:07.937958 11329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.937444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:39685 (local address 127.0.0.1:46982)
0808 08:34:07.937680 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:07.937781 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:39685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 08:34:07.939069 11329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.938678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:39685 (local address 127.0.0.1:46990)
0808 08:34:07.938843 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:07.938944 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:39685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 08:34:07.976590 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 11035
I20260808 08:34:07.993433 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 11177
I20260808 08:34:07.996462 11328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:07.994267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33274 (local address 127.5.164.195:41933)
0808 08:34:07.994479 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:07.994485 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:07.994506 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:34:07.994681 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:07.994686 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:07.994779 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:07.994893 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:07.995788 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:07.995794 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:07.995798 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:07.995816 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:07.995860 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:07.995872 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:07.996008 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:07.996123 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 08:34:07.996181 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:34:07.997112 11310 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:08.000775 11329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:08.000029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:39685 (local address 127.0.0.1:47002)
0808 08:34:08.000373 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:08.000537 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:39685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187}
I20260808 08:34:08.002069 11329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:08.001658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:39685 (local address 127.0.0.1:47010)
0808 08:34:08.001798 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:08.001902 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:39685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 08:34:08.082901 11329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:08.082361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:39685 (local address 127.0.0.1:47026)
0808 08:34:08.082601 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:08.082722 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:39685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260808 08:34:08.084105 11329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:08.083680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:39685 (local address 127.0.0.1:47040)
0808 08:34:08.083913 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:08.083982 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:39685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260808 08:34:08.089089 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 11177
I20260808 08:34:08.110121 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 10792
I20260808 08:34:08.111393 10859 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:08.219350 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 10792
2026-08-08T08:34:08Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2778 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 08:34:08.265846 5779 mini_oidc.cc:152] Starting JWKS server
I20260808 08:34:08.269316 5779 webserver.cc:460] Webserver started at https://127.0.0.1:33097/ using document root <none> and password file <none>
I20260808 08:34:08.269652 5779 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 08:34:08.270321 5779 webserver.cc:460] Webserver started at http://127.0.0.1:44579/ using document root <none> and password file <none>
2026-08-08T08:34:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:08Z Disabled control of system clock
I20260808 08:34:08.305130 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:33917
--webserver_interface=127.5.164.254
--webserver_port=0
--builtin_ntp_servers=127.5.164.212:45261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:33917
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33097/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/testchainca.cert with env {}
W20260808 08:34:08.645951 11373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:08.646313 11373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:08.646483 11373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:08.653769 11373 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:08.653927 11373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:08.654031 11373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:08.654147 11373 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:08.654227 11373 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 08:34:08.654318 11373 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 08:34:08.654397 11373 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33097/jwks.json
I20260808 08:34:08.664346 11373 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:33917
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:33917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33097/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:08.665733 11373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:08.667122 11373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:08.679169 11382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:08.679247 11379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:08.679225 11380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:08.680114 11373 server_base.cc:1034] running on GCE node
I20260808 08:34:08.680976 11373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:08.682410 11373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:08.683611 11373 hybrid_clock.cc:648] HybridClock initialized: now 1786178048683573 us; error 31 us; skew 500 ppm
I20260808 08:34:08.683976 11373 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:34:08.686319 11373 webserver.cc:460] Webserver started at http://127.5.164.254:42187/ using document root <none> and password file <none>
I20260808 08:34:08.687023 11373 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:08.687144 11373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:08.687506 11373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:08.690348 11373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "2a2f8f52952f4586b4198d08c2f83e47"
format_stamp: "Formatted at 2026-08-08 08:34:08 on dist-test-slave-chsk"
server_key: "6d906f3f000af5ba508235419b9da754"
server_key_iv: "cb8fdd9eb0621b89de3cbb4e001ea61e"
server_key_version: "encryptionkey@0"
I20260808 08:34:08.691121 11373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "2a2f8f52952f4586b4198d08c2f83e47"
format_stamp: "Formatted at 2026-08-08 08:34:08 on dist-test-slave-chsk"
server_key: "6d906f3f000af5ba508235419b9da754"
server_key_iv: "cb8fdd9eb0621b89de3cbb4e001ea61e"
server_key_version: "encryptionkey@0"
I20260808 08:34:08.696249 11373 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260808 08:34:08.699602 11388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:08.700958 11373 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 08:34:08.701177 11373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "2a2f8f52952f4586b4198d08c2f83e47"
format_stamp: "Formatted at 2026-08-08 08:34:08 on dist-test-slave-chsk"
server_key: "6d906f3f000af5ba508235419b9da754"
server_key_iv: "cb8fdd9eb0621b89de3cbb4e001ea61e"
server_key_version: "encryptionkey@0"
I20260808 08:34:08.701390 11373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:08.741287 11373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:08.742228 11373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:08.742568 11373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:08.763206 11373 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:33917
I20260808 08:34:08.763264 11443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:33917 every 8 connection(s)
I20260808 08:34:08.764636 11373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:08.767637 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 11373
I20260808 08:34:08.767866 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:34:08.768537 5779 external_mini_cluster.cc:1428] Setting key 47ba45152a20df907aa81f6bb1b78d7e
I20260808 08:34:08.768764 11444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:08.784186 11444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47: Bootstrap starting.
I20260808 08:34:08.784574 11447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:08.770639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40898 (local address 127.5.164.254:33917)
0808 08:34:08.771781 (+ 1142us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:08.771797 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:08.771852 (+ 55us) server_negotiation.cc:407] Connection header received
0808 08:34:08.774138 (+ 2286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:08.774166 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:08.774774 (+ 608us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:08.775218 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:08.775760 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:08.777754 (+ 1994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:08.779168 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:08.780202 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:08.780400 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:08.781680 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:08.781691 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:08.781708 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:08.782428 (+ 720us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:08.782543 (+ 115us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:08.782569 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:08.782698 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:08.782909 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 08:34:08.783275 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":344,"threads_started":1}
I20260808 08:34:08.787668 11444 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:08.788426 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:08.788866 11444 log.cc:824] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:08.791941 11444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47: No bootstrap required, opened a new log
I20260808 08:34:08.799970 11444 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2f8f52952f4586b4198d08c2f83e47" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 33917 } }
I20260808 08:34:08.800426 11444 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:08.800554 11444 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a2f8f52952f4586b4198d08c2f83e47, State: Initialized, Role: FOLLOWER
I20260808 08:34:08.801225 11444 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2f8f52952f4586b4198d08c2f83e47" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 33917 } }
I20260808 08:34:08.801497 11444 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:08.801652 11444 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:08.801831 11444 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:08.804556 11444 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2f8f52952f4586b4198d08c2f83e47" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 33917 } }
I20260808 08:34:08.805226 11444 leader_election.cc:302] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a2f8f52952f4586b4198d08c2f83e47; no voters:
I20260808 08:34:08.805872 11444 leader_election.cc:288] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:08.806058 11449 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:08.806892 11449 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [term 1 LEADER]: Becoming Leader. State: Replica: 2a2f8f52952f4586b4198d08c2f83e47, State: Running, Role: LEADER
I20260808 08:34:08.807507 11449 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2f8f52952f4586b4198d08c2f83e47" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 33917 } }
I20260808 08:34:08.808233 11444 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:08.810807 11450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a2f8f52952f4586b4198d08c2f83e47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2f8f52952f4586b4198d08c2f83e47" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 33917 } } }
I20260808 08:34:08.811302 11450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:08.811791 11451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a2f8f52952f4586b4198d08c2f83e47. Latest consensus state: current_term: 1 leader_uuid: "2a2f8f52952f4586b4198d08c2f83e47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a2f8f52952f4586b4198d08c2f83e47" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 33917 } } }
I20260808 08:34:08.812096 11451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:08.814293 11456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:08.819917 11456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:08.829857 11456 catalog_manager.cc:1347] Generated new cluster ID: 1c5cb5d9311440daa4ba5f4ee6b8d16f
I20260808 08:34:08.830004 11456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:08.854724 11456 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:08.856822 11456 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:08.873714 11456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a2f8f52952f4586b4198d08c2f83e47: Generated new TSK 0
I20260808 08:34:08.874810 11456 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 08:34:08.923094 11476 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 08:34:08.923419 11476 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 08:34:08.924459 11447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:08.901884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40910 (local address 127.5.164.254:33917)
0808 08:34:08.902116 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:08.902124 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:08.902640 (+ 516us) server_negotiation.cc:407] Connection header received
0808 08:34:08.903004 (+ 364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:08.903010 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:08.903113 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:08.903306 (+ 193us) server_negotiation.cc:226] Negotiated authn=JWT
0808 08:34:08.903835 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:08.905001 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:08.906545 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:08.907345 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:08.907478 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:08.908089 (+ 611us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 08:34:08.923890 (+ 15801us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33097/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 08:34:08.924216 (+ 326us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40910: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33097/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":75}
W20260808 08:34:08.924618 11447 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40910: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33097/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 08:34:08.926776 11475 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:08.901732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:33917 (local address 127.0.0.1:40910)
0808 08:34:08.902524 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:08.902541 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:08.902700 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:08.903332 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:08.903336 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:08.903347 (+ 11us) client_negotiation.cc:189] Negotiated authn=JWT
0808 08:34:08.903666 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:08.903673 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:08.905166 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:08.905169 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:08.906403 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:08.906414 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:08.907525 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:08.907530 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:08.907663 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:08.907732 (+ 69us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 08:34:08.924231 (+ 16499us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33097/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 08:34:08.924641 (+ 410us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.164.254:33917: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33097/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":440,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.5.164.254:33917: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33097/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 08:34:08.928714 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 11373
I20260808 08:34:08.930296 11439 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:09.030167 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 11373
2026-08-08T08:34:09Z chronyd exiting
I20260808 08:34:09.082846 5779 test_util.cc:175] -----------------------------------------------
I20260808 08:34:09.083006 5779 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786178004478096-5779-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (821 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 08:34:09.086942 5779 mini_oidc.cc:152] Starting JWKS server
I20260808 08:34:09.088905 5779 webserver.cc:460] Webserver started at https://127.0.0.1:38125/ using document root <none> and password file <none>
I20260808 08:34:09.089112 5779 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 08:34:09.089756 5779 webserver.cc:460] Webserver started at http://127.0.0.1:34317/ using document root <none> and password file <none>
2026-08-08T08:34:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:09Z Disabled control of system clock
I20260808 08:34:09.126315 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:45255
--webserver_interface=127.5.164.254
--webserver_port=0
--builtin_ntp_servers=127.5.164.212:44457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:45255
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38125/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/testchainca.cert with env {}
W20260808 08:34:09.469184 11483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:09.469545 11483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:09.469719 11483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:09.476850 11483 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:09.477012 11483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:09.477109 11483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:09.477211 11483 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:09.477300 11483 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 08:34:09.477392 11483 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 08:34:09.477470 11483 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38125/jwks.json
I20260808 08:34:09.487411 11483 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:44457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:45255
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:45255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38125/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:09.488821 11483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:09.490286 11483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:09.502301 11493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:09.502287 11491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:09.502847 11490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:09.503255 11483 server_base.cc:1034] running on GCE node
I20260808 08:34:09.504151 11483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:09.505704 11483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:09.506969 11483 hybrid_clock.cc:648] HybridClock initialized: now 1786178049506903 us; error 62 us; skew 500 ppm
I20260808 08:34:09.507468 11483 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:34:09.510136 11483 webserver.cc:460] Webserver started at http://127.5.164.254:40061/ using document root <none> and password file <none>
I20260808 08:34:09.510906 11483 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:09.511055 11483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:09.511449 11483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:09.514599 11483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "bbb7a78032f54293b3d51487971b8e18"
format_stamp: "Formatted at 2026-08-08 08:34:09 on dist-test-slave-chsk"
server_key: "3335eacc6e43d900ae4e005972427d4e"
server_key_iv: "bdac7a7aefc0ee140fb710af9699595e"
server_key_version: "encryptionkey@0"
I20260808 08:34:09.515535 11483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "bbb7a78032f54293b3d51487971b8e18"
format_stamp: "Formatted at 2026-08-08 08:34:09 on dist-test-slave-chsk"
server_key: "3335eacc6e43d900ae4e005972427d4e"
server_key_iv: "bdac7a7aefc0ee140fb710af9699595e"
server_key_version: "encryptionkey@0"
I20260808 08:34:09.521152 11483 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 08:34:09.524711 11500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:09.526072 11483 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:34:09.526283 11483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "bbb7a78032f54293b3d51487971b8e18"
format_stamp: "Formatted at 2026-08-08 08:34:09 on dist-test-slave-chsk"
server_key: "3335eacc6e43d900ae4e005972427d4e"
server_key_iv: "bdac7a7aefc0ee140fb710af9699595e"
server_key_version: "encryptionkey@0"
I20260808 08:34:09.526526 11483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:09.545519 11483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:09.546420 11483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:09.546748 11483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:09.565959 11483 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:45255
I20260808 08:34:09.565996 11552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:45255 every 8 connection(s)
I20260808 08:34:09.567369 11483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:09.570675 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 11483
I20260808 08:34:09.570884 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:34:09.571251 11553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:09.571715 5779 external_mini_cluster.cc:1428] Setting key 191fc0e64469f32a84642a7358685764
I20260808 08:34:09.584664 11553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18: Bootstrap starting.
I20260808 08:34:09.586261 11556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:09.573701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60790 (local address 127.5.164.254:45255)
0808 08:34:09.574831 (+ 1130us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:09.574842 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:09.574899 (+ 57us) server_negotiation.cc:407] Connection header received
0808 08:34:09.577153 (+ 2254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:09.577175 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:09.577641 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:09.577967 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:09.578565 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:09.579907 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:09.581771 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:09.582519 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:09.582653 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:09.583918 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:09.583925 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:09.583937 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:09.584475 (+ 538us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:09.584557 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:09.584578 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:09.584669 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:09.584958 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 08:34:09.585318 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670,"thread_start_us":426,"threads_started":1}
I20260808 08:34:09.588038 11553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:09.589210 11553 log.cc:824] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:09.590157 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:09.592108 11553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18: No bootstrap required, opened a new log
I20260808 08:34:09.599356 11553 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbb7a78032f54293b3d51487971b8e18" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45255 } }
I20260808 08:34:09.599741 11553 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:09.599859 11553 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbb7a78032f54293b3d51487971b8e18, State: Initialized, Role: FOLLOWER
I20260808 08:34:09.600426 11553 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbb7a78032f54293b3d51487971b8e18" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45255 } }
I20260808 08:34:09.600674 11553 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:09.600827 11553 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:09.601002 11553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:09.603312 11553 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbb7a78032f54293b3d51487971b8e18" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45255 } }
I20260808 08:34:09.603883 11553 leader_election.cc:302] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbb7a78032f54293b3d51487971b8e18; no voters:
I20260808 08:34:09.604485 11553 leader_election.cc:288] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:09.604658 11558 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:09.605379 11558 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [term 1 LEADER]: Becoming Leader. State: Replica: bbb7a78032f54293b3d51487971b8e18, State: Running, Role: LEADER
I20260808 08:34:09.605885 11558 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbb7a78032f54293b3d51487971b8e18" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45255 } }
I20260808 08:34:09.606645 11553 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:09.608980 11559 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbb7a78032f54293b3d51487971b8e18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbb7a78032f54293b3d51487971b8e18" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45255 } } }
I20260808 08:34:09.609459 11559 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:09.608954 11560 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbb7a78032f54293b3d51487971b8e18. Latest consensus state: current_term: 1 leader_uuid: "bbb7a78032f54293b3d51487971b8e18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbb7a78032f54293b3d51487971b8e18" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45255 } } }
I20260808 08:34:09.616119 11560 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:09.617115 11564 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:09.623260 11564 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:09.633883 11564 catalog_manager.cc:1347] Generated new cluster ID: 686a0272e28d4626bfab303cedf2cc07
I20260808 08:34:09.634061 11564 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:09.644309 11564 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:09.645744 11564 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:09.657837 11564 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbb7a78032f54293b3d51487971b8e18: Generated new TSK 0
I20260808 08:34:09.658866 11564 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 08:34:09.701542 11587 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 08:34:09.701676 11587 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 08:34:09.703001 11556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:09.681749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60798 (local address 127.5.164.254:45255)
0808 08:34:09.681981 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:09.682001 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:09.682651 (+ 650us) server_negotiation.cc:407] Connection header received
0808 08:34:09.682885 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:09.682891 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:09.682980 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:09.683169 (+ 189us) server_negotiation.cc:226] Negotiated authn=JWT
0808 08:34:09.683619 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:09.684791 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:09.686184 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:09.686887 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:09.687014 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:09.687618 (+ 604us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 08:34:09.702261 (+ 14643us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38125/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 08:34:09.702670 (+ 409us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60798: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38125/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":84}
W20260808 08:34:09.703032 11586 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:09.681441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:45255 (local address 127.0.0.1:60798)
0808 08:34:09.682554 (+ 1113us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:09.682572 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:09.682694 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:09.683216 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:09.683219 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:09.683229 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0808 08:34:09.683476 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:09.683484 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:09.684950 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:09.684953 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:09.686037 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:09.686047 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:09.687047 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:09.687051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:09.687272 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:09.687306 (+ 34us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 08:34:09.702514 (+ 15208us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38125/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 08:34:09.702720 (+ 206us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.164.254:45255: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38125/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":943,"thread_start_us":702,"threads_started":1}
W20260808 08:34:09.703168 11556 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60798: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38125/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260808 08:34:09.704790 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 11483
I20260808 08:34:09.705960 11548 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:09.804756 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 11483
2026-08-08T08:34:09Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (777 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 08:34:09.864246 5779 mini_oidc.cc:152] Starting JWKS server
I20260808 08:34:09.866186 5779 webserver.cc:460] Webserver started at https://127.0.0.1:43189/ using document root <none> and password file <none>
I20260808 08:34:09.866454 5779 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 08:34:09.867120 5779 webserver.cc:460] Webserver started at http://127.0.0.1:33133/ using document root <none> and password file <none>
2026-08-08T08:34:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:09Z Disabled control of system clock
I20260808 08:34:09.902261 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:45775
--webserver_interface=127.5.164.254
--webserver_port=0
--builtin_ntp_servers=127.5.164.212:41361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:45775
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43189/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 08:34:10.237980 11594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:10.238343 11594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:10.238507 11594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:10.245972 11594 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:10.246129 11594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:10.246227 11594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:10.246347 11594 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:10.246429 11594 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 08:34:10.246521 11594 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 08:34:10.246601 11594 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43189/jwks.json
I20260808 08:34:10.256459 11594 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:41361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:45775
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:45775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43189/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:10.257872 11594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:10.259840 11594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:10.271950 11600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:10.271973 11602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:10.272078 11599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:10.272598 11594 server_base.cc:1034] running on GCE node
I20260808 08:34:10.273519 11594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:10.274992 11594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:10.276232 11594 hybrid_clock.cc:648] HybridClock initialized: now 1786178050276191 us; error 60 us; skew 500 ppm
I20260808 08:34:10.276620 11594 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:34:10.283223 11594 webserver.cc:460] Webserver started at http://127.5.164.254:40849/ using document root <none> and password file <none>
I20260808 08:34:10.284056 11594 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:10.284210 11594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:10.284590 11594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:10.288106 11594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "174c84c763264272b4ef5a54941069ac"
format_stamp: "Formatted at 2026-08-08 08:34:10 on dist-test-slave-chsk"
server_key: "c994c55d213af772376cdd4675399a04"
server_key_iv: "0df6f39d441276ea2623d85f43d47d1e"
server_key_version: "encryptionkey@0"
I20260808 08:34:10.288995 11594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "174c84c763264272b4ef5a54941069ac"
format_stamp: "Formatted at 2026-08-08 08:34:10 on dist-test-slave-chsk"
server_key: "c994c55d213af772376cdd4675399a04"
server_key_iv: "0df6f39d441276ea2623d85f43d47d1e"
server_key_version: "encryptionkey@0"
I20260808 08:34:10.294642 11594 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:34:10.298422 11609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:10.299978 11594 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:10.300208 11594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "174c84c763264272b4ef5a54941069ac"
format_stamp: "Formatted at 2026-08-08 08:34:10 on dist-test-slave-chsk"
server_key: "c994c55d213af772376cdd4675399a04"
server_key_iv: "0df6f39d441276ea2623d85f43d47d1e"
server_key_version: "encryptionkey@0"
I20260808 08:34:10.300459 11594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:10.312392 11594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:10.313284 11594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:10.313623 11594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:10.333231 11594 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:45775
I20260808 08:34:10.333249 11664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:45775 every 8 connection(s)
I20260808 08:34:10.334684 11594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:10.338585 11665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:10.344245 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 11594
I20260808 08:34:10.344463 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:34:10.345285 5779 external_mini_cluster.cc:1428] Setting key e3beef770b10dd581d46f76c5f13b02e
I20260808 08:34:10.350543 11665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac: Bootstrap starting.
I20260808 08:34:10.354207 11665 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:10.355571 11665 log.cc:824] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:10.358902 11665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac: No bootstrap required, opened a new log
I20260808 08:34:10.359772 11669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:10.347486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56128 (local address 127.5.164.254:45775)
0808 08:34:10.348636 (+ 1150us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:10.348649 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:10.348692 (+ 43us) server_negotiation.cc:407] Connection header received
0808 08:34:10.350341 (+ 1649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:10.350363 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:10.350871 (+ 508us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:10.351252 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:10.351821 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:10.353096 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:10.355031 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:10.355865 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:10.356003 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:10.357324 (+ 1321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:10.357331 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:10.357344 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:10.357867 (+ 523us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:10.357961 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:10.357981 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:10.358067 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:10.358321 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 08:34:10.358631 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":693,"thread_start_us":457,"threads_started":1}
I20260808 08:34:10.363898 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:10.367210 11665 raft_consensus.cc:348] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174c84c763264272b4ef5a54941069ac" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45775 } }
I20260808 08:34:10.367625 11665 raft_consensus.cc:374] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:10.367746 11665 raft_consensus.cc:729] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 174c84c763264272b4ef5a54941069ac, State: Initialized, Role: FOLLOWER
I20260808 08:34:10.368341 11665 consensus_queue.cc:260] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174c84c763264272b4ef5a54941069ac" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45775 } }
I20260808 08:34:10.368613 11665 raft_consensus.cc:388] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:10.368765 11665 raft_consensus.cc:482] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:10.368954 11665 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:10.371533 11665 raft_consensus.cc:504] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174c84c763264272b4ef5a54941069ac" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45775 } }
I20260808 08:34:10.372074 11665 leader_election.cc:302] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 174c84c763264272b4ef5a54941069ac; no voters:
I20260808 08:34:10.372687 11665 leader_election.cc:288] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:10.372829 11672 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:10.373597 11672 raft_consensus.cc:686] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [term 1 LEADER]: Becoming Leader. State: Replica: 174c84c763264272b4ef5a54941069ac, State: Running, Role: LEADER
I20260808 08:34:10.374243 11672 consensus_queue.cc:237] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174c84c763264272b4ef5a54941069ac" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45775 } }
I20260808 08:34:10.374907 11665 sys_catalog.cc:564] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:10.377038 11674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 174c84c763264272b4ef5a54941069ac. Latest consensus state: current_term: 1 leader_uuid: "174c84c763264272b4ef5a54941069ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174c84c763264272b4ef5a54941069ac" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45775 } } }
I20260808 08:34:10.377439 11674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:10.377476 11673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "174c84c763264272b4ef5a54941069ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174c84c763264272b4ef5a54941069ac" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45775 } } }
I20260808 08:34:10.378005 11673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:10.380049 11677 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:10.384991 11677 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:10.395512 11677 catalog_manager.cc:1347] Generated new cluster ID: 09f78fde6aea440aa68ca8ec23ff87ef
I20260808 08:34:10.395656 11677 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:10.443749 11677 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:10.445684 11677 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:10.458096 11677 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 174c84c763264272b4ef5a54941069ac: Generated new TSK 0
I20260808 08:34:10.459192 11677 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:10.483577 11669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:10.475240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56140 (local address 127.5.164.254:45775)
0808 08:34:10.475440 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:10.475447 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:10.476003 (+ 556us) server_negotiation.cc:407] Connection header received
0808 08:34:10.476354 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:10.476359 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:10.476436 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:10.476597 (+ 161us) server_negotiation.cc:226] Negotiated authn=JWT
0808 08:34:10.477102 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:10.477860 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:10.479308 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:10.479763 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:10.479907 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:10.480451 (+ 544us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 08:34:10.482880 (+ 2429us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43189/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 08:34:10.483234 (+ 354us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56140: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43189/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":56}
W20260808 08:34:10.483714 11669 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56140: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43189/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 08:34:10.485673 11699 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:10.475224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:45775 (local address 127.0.0.1:56140)
0808 08:34:10.475901 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:10.475924 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:10.476110 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:10.476627 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:10.476631 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:10.476646 (+ 15us) client_negotiation.cc:189] Negotiated authn=JWT
0808 08:34:10.476931 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:10.476940 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:10.478022 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:10.478027 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:10.479109 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:10.479121 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:10.479963 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:10.479973 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:10.480127 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:10.480161 (+ 34us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 08:34:10.483104 (+ 2943us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43189/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 08:34:10.485204 (+ 2100us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.164.254:45775: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43189/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":515,"mutex_wait_us":1737,"thread_start_us":371,"threads_started":1}
I20260808 08:34:10.487469 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 11594
I20260808 08:34:10.488878 11660 generic_service.cc:196] Checking for leaks (request via RPC)
E20260808 08:34:10.499553 11700 webserver.cc:533] Webserver: sslize failed:
E20260808 08:34:10.499704 11700 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 08:34:10.586901 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 11594
2026-08-08T08:34:10Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (782 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T08:34:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:10Z Disabled control of system clock
I20260808 08:34:10.680321 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:43089
--webserver_interface=127.5.164.254
--webserver_port=0
--builtin_ntp_servers=127.5.164.212:45887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:43089
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/testchainca.cert with env {}
W20260808 08:34:11.016708 11705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:11.017030 11705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:11.017131 11705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:11.024626 11705 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:11.024744 11705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:11.024788 11705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:11.024848 11705 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:11.024901 11705 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 08:34:11.024959 11705 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 08:34:11.025008 11705 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 08:34:11.035070 11705 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:43089
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:43089
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:11.036394 11705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:11.037675 11705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:11.049693 11710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:11.049661 11711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:11.049736 11713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:11.050737 11705 server_base.cc:1034] running on GCE node
I20260808 08:34:11.051641 11705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:11.053177 11705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:11.054435 11705 hybrid_clock.cc:648] HybridClock initialized: now 1786178051054402 us; error 56 us; skew 500 ppm
I20260808 08:34:11.054821 11705 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:34:11.057542 11705 webserver.cc:460] Webserver started at http://127.5.164.254:42801/ using document root <none> and password file <none>
I20260808 08:34:11.058296 11705 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:11.058440 11705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:11.058786 11705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:11.061959 11705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "c398a365fb42482591fe945d789b8f56"
format_stamp: "Formatted at 2026-08-08 08:34:11 on dist-test-slave-chsk"
server_key: "b4c96eec044c904b02921c6ba9b5e76d"
server_key_iv: "9c0ebebc0dbb9d156e6196db0a73c728"
server_key_version: "encryptionkey@0"
I20260808 08:34:11.062852 11705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "c398a365fb42482591fe945d789b8f56"
format_stamp: "Formatted at 2026-08-08 08:34:11 on dist-test-slave-chsk"
server_key: "b4c96eec044c904b02921c6ba9b5e76d"
server_key_iv: "9c0ebebc0dbb9d156e6196db0a73c728"
server_key_version: "encryptionkey@0"
I20260808 08:34:11.068464 11705 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260808 08:34:11.072338 11719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:11.073823 11705 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260808 08:34:11.074048 11705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "c398a365fb42482591fe945d789b8f56"
format_stamp: "Formatted at 2026-08-08 08:34:11 on dist-test-slave-chsk"
server_key: "b4c96eec044c904b02921c6ba9b5e76d"
server_key_iv: "9c0ebebc0dbb9d156e6196db0a73c728"
server_key_version: "encryptionkey@0"
I20260808 08:34:11.074334 11705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:11.094009 11705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:11.094990 11705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:11.095289 11705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:11.115217 11705 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:43089
I20260808 08:34:11.115192 11776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:43089 every 8 connection(s)
I20260808 08:34:11.116744 11705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:11.120738 11777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:11.125699 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 11705
I20260808 08:34:11.125944 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:34:11.126684 5779 external_mini_cluster.cc:1428] Setting key 9ee344c62e66ba6128b83641839fcd47
I20260808 08:34:11.132731 11777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56: Bootstrap starting.
I20260808 08:34:11.136034 11777 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:11.137181 11777 log.cc:824] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:11.140993 11777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56: No bootstrap required, opened a new log
I20260808 08:34:11.141477 11781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:11.128778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49776 (local address 127.5.164.254:43089)
0808 08:34:11.129904 (+ 1126us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:11.129915 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:11.129962 (+ 47us) server_negotiation.cc:407] Connection header received
0808 08:34:11.131852 (+ 1890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:11.131878 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:11.132363 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:11.132773 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:11.133372 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:11.134730 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:11.136180 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:11.136886 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:11.137103 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:11.138501 (+ 1398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:11.138510 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:11.138525 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:11.139318 (+ 793us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:11.139428 (+ 110us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:11.139456 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:11.139585 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:11.139841 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 08:34:11.140192 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":683,"thread_start_us":389,"threads_started":1}
I20260808 08:34:11.145771 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:34:11.150744 11777 raft_consensus.cc:348] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c398a365fb42482591fe945d789b8f56" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43089 } }
I20260808 08:34:11.151235 11777 raft_consensus.cc:374] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:11.151327 11777 raft_consensus.cc:729] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c398a365fb42482591fe945d789b8f56, State: Initialized, Role: FOLLOWER
I20260808 08:34:11.151916 11777 consensus_queue.cc:260] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c398a365fb42482591fe945d789b8f56" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43089 } }
I20260808 08:34:11.152123 11777 raft_consensus.cc:388] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:11.152236 11777 raft_consensus.cc:482] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:11.152367 11777 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:11.154565 11777 raft_consensus.cc:504] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c398a365fb42482591fe945d789b8f56" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43089 } }
I20260808 08:34:11.155030 11777 leader_election.cc:302] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c398a365fb42482591fe945d789b8f56; no voters:
I20260808 08:34:11.155717 11777 leader_election.cc:288] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:11.155941 11783 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:11.156890 11783 raft_consensus.cc:686] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [term 1 LEADER]: Becoming Leader. State: Replica: c398a365fb42482591fe945d789b8f56, State: Running, Role: LEADER
I20260808 08:34:11.157616 11783 consensus_queue.cc:237] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c398a365fb42482591fe945d789b8f56" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43089 } }
I20260808 08:34:11.158823 11777 sys_catalog.cc:564] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:11.160703 11784 sys_catalog.cc:455] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c398a365fb42482591fe945d789b8f56. Latest consensus state: current_term: 1 leader_uuid: "c398a365fb42482591fe945d789b8f56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c398a365fb42482591fe945d789b8f56" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43089 } } }
I20260808 08:34:11.161468 11784 sys_catalog.cc:458] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:11.160887 11785 sys_catalog.cc:455] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c398a365fb42482591fe945d789b8f56" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c398a365fb42482591fe945d789b8f56" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43089 } } }
I20260808 08:34:11.162135 11785 sys_catalog.cc:458] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:11.171746 11788 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:11.178457 11788 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:11.190970 11788 catalog_manager.cc:1347] Generated new cluster ID: 94a77153ed1e4bb4a64b712cdfa0798e
I20260808 08:34:11.191124 11788 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:11.220481 11788 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:11.222019 11788 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:11.228259 11788 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c398a365fb42482591fe945d789b8f56: Generated new TSK 0
I20260808 08:34:11.229148 11788 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:11.308602 11781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:11.242876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49784 (local address 127.5.164.254:43089)
0808 08:34:11.243102 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:11.243110 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:11.243490 (+ 380us) server_negotiation.cc:407] Connection header received
0808 08:34:11.243792 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:11.243796 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:11.243873 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:11.244039 (+ 166us) server_negotiation.cc:226] Negotiated authn=JWT
0808 08:34:11.244728 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:11.245506 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:11.247005 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:11.247561 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:11.247754 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:11.248368 (+ 614us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 08:34:11.307749 (+ 59381us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 08:34:11.308228 (+ 479us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49784: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":58}
W20260808 08:34:11.308785 11781 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49784: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 08:34:11.308873 11811 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:11.242709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:43089 (local address 127.0.0.1:49784)
0808 08:34:11.243383 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:11.243400 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:11.243577 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:11.244068 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:11.244073 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:11.244089 (+ 16us) client_negotiation.cc:189] Negotiated authn=JWT
0808 08:34:11.244385 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:11.244396 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:11.245696 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:11.245704 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:11.246832 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:11.246845 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:11.247815 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:11.247825 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:11.247974 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:11.248012 (+ 38us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 08:34:11.308098 (+ 60086us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 08:34:11.308442 (+ 344us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.5.164.254:43089: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":444,"threads_started":1}
I20260808 08:34:11.310856 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 11705
I20260808 08:34:11.312186 11771 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:11.413388 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 11705
2026-08-08T08:34:11Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (806 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (440 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (424 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:12 dist-test-slave-chsk krb5kdc[11826](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:12 dist-test-slave-chsk krb5kdc[11826](info): set up 2 sockets
Aug 08 08:34:12 dist-test-slave-chsk krb5kdc[11826](info): commencing operation
krb5kdc: starting...
W20260808 08:34:13.444801 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:34:13 dist-test-slave-chsk krb5kdc[11826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:34:13.698366 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:44241
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:40045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:44241
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:14.041426 11840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:14.041730 11840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:14.041858 11840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:14.049170 11840 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:14.049283 11840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:14.049371 11840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:14.049458 11840 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:14.049526 11840 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:14.059641 11840 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:40045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:44241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:44241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:14.060951 11840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:14.062260 11840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:14.074139 11848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:14.074179 11846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:14.074086 11845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:14.075745 11840 server_base.cc:1034] running on GCE node
I20260808 08:34:14.076483 11840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:14.077826 11840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:14.079034 11840 hybrid_clock.cc:648] HybridClock initialized: now 1786178054078988 us; error 36 us; skew 500 ppm
I20260808 08:34:14.079413 11840 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:14 dist-test-slave-chsk krb5kdc[11826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178054, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:14.082593 11840 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:34:14.084098 11840 webserver.cc:460] Webserver started at http://127.5.164.254:34715/ using document root <none> and password file <none>
I20260808 08:34:14.084779 11840 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:14.084914 11840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:14.085250 11840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:14.088258 11840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "a5b9ff745e1f4517b8e95cd1c6141571"
format_stamp: "Formatted at 2026-08-08 08:34:14 on dist-test-slave-chsk"
server_key: "b628b910ab0d822429566c4adf4b5f2f"
server_key_iv: "ba80b8ab4ee78042c99979169ed2b369"
server_key_version: "encryptionkey@0"
I20260808 08:34:14.089056 11840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "a5b9ff745e1f4517b8e95cd1c6141571"
format_stamp: "Formatted at 2026-08-08 08:34:14 on dist-test-slave-chsk"
server_key: "b628b910ab0d822429566c4adf4b5f2f"
server_key_iv: "ba80b8ab4ee78042c99979169ed2b369"
server_key_version: "encryptionkey@0"
I20260808 08:34:14.094316 11840 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260808 08:34:14.097882 11855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:14.099300 11840 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:14.099485 11840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "a5b9ff745e1f4517b8e95cd1c6141571"
format_stamp: "Formatted at 2026-08-08 08:34:14 on dist-test-slave-chsk"
server_key: "b628b910ab0d822429566c4adf4b5f2f"
server_key_iv: "ba80b8ab4ee78042c99979169ed2b369"
server_key_version: "encryptionkey@0"
I20260808 08:34:14.099682 11840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:14.129073 11840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:14.133759 11840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:14.134131 11840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:14.154059 11840 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:44241
I20260808 08:34:14.154162 11908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:44241 every 8 connection(s)
I20260808 08:34:14.155525 11840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:14.159307 11909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:14.164971 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 11840
I20260808 08:34:14.165198 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:34:14.165850 5779 external_mini_cluster.cc:1428] Setting key 9c02933a8127a80e037c4660f5617505
I20260808 08:34:14.171936 11909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571: Bootstrap starting.
I20260808 08:34:14.175915 11909 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:14.176959 11909 log.cc:824] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:14.180130 11909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571: No bootstrap required, opened a new log
Aug 08 08:34:14 dist-test-slave-chsk krb5kdc[11826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178053, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:34:14.191028 11909 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5b9ff745e1f4517b8e95cd1c6141571" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 44241 } }
I20260808 08:34:14.191521 11909 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:14.191638 11909 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5b9ff745e1f4517b8e95cd1c6141571, State: Initialized, Role: FOLLOWER
I20260808 08:34:14.191881 11912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:14.168019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60634 (local address 127.5.164.254:44241)
0808 08:34:14.168956 (+ 937us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:14.168976 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:14.169032 (+ 56us) server_negotiation.cc:407] Connection header received
0808 08:34:14.171591 (+ 2559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:14.171619 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:14.172168 (+ 549us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:14.172641 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:14.173938 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:14.175981 (+ 2043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:14.177301 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:14.178176 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:14.178381 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:14.182673 (+ 4292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:14.182684 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:14.182704 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:14.182759 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:14.186891 (+ 4132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:14.187726 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:14.187735 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:14.187745 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:14.187965 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:14.188335 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:14.188342 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:14.188346 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:14.189129 (+ 783us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:14.189435 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:14.189781 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 08:34:14.190425 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":675,"thread_start_us":405,"threads_started":1}
I20260808 08:34:14.192327 11909 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5b9ff745e1f4517b8e95cd1c6141571" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 44241 } }
I20260808 08:34:14.192598 11909 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:14.192770 11909 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:14.192965 11909 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:14.195621 11909 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5b9ff745e1f4517b8e95cd1c6141571" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 44241 } }
I20260808 08:34:14.196180 11909 leader_election.cc:302] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5b9ff745e1f4517b8e95cd1c6141571; no voters:
I20260808 08:34:14.196763 11909 leader_election.cc:288] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:14.196923 11914 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:14.198065 11914 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [term 1 LEADER]: Becoming Leader. State: Replica: a5b9ff745e1f4517b8e95cd1c6141571, State: Running, Role: LEADER
I20260808 08:34:14.198606 11914 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5b9ff745e1f4517b8e95cd1c6141571" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 44241 } }
I20260808 08:34:14.199065 11909 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:14.202080 11916 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a5b9ff745e1f4517b8e95cd1c6141571" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5b9ff745e1f4517b8e95cd1c6141571" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 44241 } } }
I20260808 08:34:14.202163 11917 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5b9ff745e1f4517b8e95cd1c6141571. Latest consensus state: current_term: 1 leader_uuid: "a5b9ff745e1f4517b8e95cd1c6141571" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5b9ff745e1f4517b8e95cd1c6141571" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 44241 } } }
I20260808 08:34:14.202518 11916 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:14.202572 11917 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:14.208057 11925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:14.213501 11925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:14.222857 11925 catalog_manager.cc:1347] Generated new cluster ID: 305b9aae69c2492aa70a4b8508f9866e
I20260808 08:34:14.222999 11925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:14.243311 11925 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:14.245476 11925 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:14.252322 11925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5b9ff745e1f4517b8e95cd1c6141571: Generated new TSK 0
I20260808 08:34:14.253156 11925 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:34:14.322301 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:44241
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:40045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:14.671090 11940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:14.671401 11940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:14.671497 11940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:14.678737 11940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:14.678859 11940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:14.678972 11940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:34:14.689162 11940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:40045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:44241
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:14.690670 11940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:14.692209 11940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:14.706429 11945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:14.706388 11948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:14.706408 11946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:14.712641 11940 server_base.cc:1034] running on GCE node
I20260808 08:34:14.713299 11940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:14.714279 11940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:14.715508 11940 hybrid_clock.cc:648] HybridClock initialized: now 1786178054715445 us; error 46 us; skew 500 ppm
I20260808 08:34:14.715842 11940 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:14 dist-test-slave-chsk krb5kdc[11826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178054, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:14.719310 11940 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:34:14.720942 11940 webserver.cc:460] Webserver started at http://127.5.164.193:44153/ using document root <none> and password file <none>
I20260808 08:34:14.721727 11940 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:14.721877 11940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:14.722218 11940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:14.725267 11940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "4232fb4d99084120a6829f71a1129c59"
format_stamp: "Formatted at 2026-08-08 08:34:14 on dist-test-slave-chsk"
server_key: "d9e15a1c3d7c6244c1cf16f2c6f2e7c8"
server_key_iv: "1191ab52f5ad404b126898a206d61924"
server_key_version: "encryptionkey@0"
I20260808 08:34:14.726087 11940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "4232fb4d99084120a6829f71a1129c59"
format_stamp: "Formatted at 2026-08-08 08:34:14 on dist-test-slave-chsk"
server_key: "d9e15a1c3d7c6244c1cf16f2c6f2e7c8"
server_key_iv: "1191ab52f5ad404b126898a206d61924"
server_key_version: "encryptionkey@0"
I20260808 08:34:14.731706 11940 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260808 08:34:14.735402 11956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:14.737056 11940 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:34:14.737269 11940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "4232fb4d99084120a6829f71a1129c59"
format_stamp: "Formatted at 2026-08-08 08:34:14 on dist-test-slave-chsk"
server_key: "d9e15a1c3d7c6244c1cf16f2c6f2e7c8"
server_key_iv: "1191ab52f5ad404b126898a206d61924"
server_key_version: "encryptionkey@0"
I20260808 08:34:14.737510 11940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:14.756711 11940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:14.761083 11940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:14.761399 11940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:14.762444 11940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:14.763942 11940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:14.764051 11940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:14.764210 11940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:14.764287 11940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:14.798957 11940 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:32923
I20260808 08:34:14.799013 12077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:32923 every 8 connection(s)
I20260808 08:34:14.800438 11940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:34:14.802027 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 11940
I20260808 08:34:14.802253 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:34:14.803071 5779 external_mini_cluster.cc:1428] Setting key f3cb70361756486eebe53cd8ecd8cde2
Aug 08 08:34:14 dist-test-slave-chsk krb5kdc[11826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178054, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:34:14.822042 12080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:14.803463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:49657 (local address 127.5.164.254:44241)
0808 08:34:14.803999 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:14.804007 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:14.806916 (+ 2909us) server_negotiation.cc:407] Connection header received
0808 08:34:14.806974 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:14.806978 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:14.807039 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:14.807193 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:14.808800 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:14.809565 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:14.811222 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:14.811622 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:14.811772 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:14.815565 (+ 3793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:14.815570 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:14.815573 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:14.815608 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:14.818644 (+ 3036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:14.819549 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:14.819554 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:14.819557 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:14.819685 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:14.820153 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:14.820157 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:14.820159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:14.820453 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:14.820610 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:14.821391 (+ 781us) server_negotiation.cc:299] Negotiation successful
0808 08:34:14.821635 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":266,"threads_started":1}
I20260808 08:34:14.823081 12081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:14.803989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:44241 (local address 127.5.164.193:49657)
0808 08:34:14.804878 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:14.804945 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:14.806639 (+ 1694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:14.807444 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:14.807453 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:14.807995 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:14.808611 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:14.808629 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:14.809757 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:14.809761 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:14.811033 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:14.811045 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:14.811890 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:14.811898 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:14.812130 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:14.812844 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:14.812872 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:14.815273 (+ 2401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:14.818821 (+ 3548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:14.818831 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:14.818850 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:14.819400 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:14.819807 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:14.819812 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:14.819815 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:14.820017 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:14.820596 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:14.820604 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:14.820972 (+ 368us) client_negotiation.cc:769] Sending connection context
0808 08:34:14.821261 (+ 289us) client_negotiation.cc:240] Negotiation successful
0808 08:34:14.821865 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":353,"threads_started":1}
I20260808 08:34:14.825002 12078 heartbeater.cc:347] Connected to a master server at 127.5.164.254:44241
I20260808 08:34:14.825322 12078 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:14.826118 12078 heartbeater.cc:511] Master 127.5.164.254:44241 requested a full tablet report, sending...
I20260808 08:34:14.828766 11873 ts_manager.cc:194] Registered new tserver with Master: 4232fb4d99084120a6829f71a1129c59 (127.5.164.193:32923)
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
I20260808 08:34:14.830457 11873 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:49657
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:34:14.862531 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:44241
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:40045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:15.198473 12084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:15.198742 12084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:15.198870 12084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:15.206507 12084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:15.206643 12084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:15.206835 12084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:34:15.216946 12084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:40045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:44241
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:15.218302 12084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:15.219735 12084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:15.232904 12089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:15.233125 12090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:15.233153 12092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:15.234102 12084 server_base.cc:1034] running on GCE node
I20260808 08:34:15.234805 12084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:15.235812 12084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:15.237016 12084 hybrid_clock.cc:648] HybridClock initialized: now 1786178055236974 us; error 26 us; skew 500 ppm
I20260808 08:34:15.237336 12084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:15 dist-test-slave-chsk krb5kdc[11826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:15.240556 12084 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:34:15.242354 12084 webserver.cc:460] Webserver started at http://127.5.164.194:43917/ using document root <none> and password file <none>
I20260808 08:34:15.243046 12084 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:15.243227 12084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:15.243551 12084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:15.246582 12084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "be7554e806fd43d4aab2305e7dbb7674"
format_stamp: "Formatted at 2026-08-08 08:34:15 on dist-test-slave-chsk"
server_key: "39187197d9ebf0e957fbf70a623d9b63"
server_key_iv: "d59e230944d267f0709cac2b8e84ba02"
server_key_version: "encryptionkey@0"
I20260808 08:34:15.247478 12084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "be7554e806fd43d4aab2305e7dbb7674"
format_stamp: "Formatted at 2026-08-08 08:34:15 on dist-test-slave-chsk"
server_key: "39187197d9ebf0e957fbf70a623d9b63"
server_key_iv: "d59e230944d267f0709cac2b8e84ba02"
server_key_version: "encryptionkey@0"
I20260808 08:34:15.252584 12084 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 08:34:15.255937 12100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:15.257256 12084 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:34:15.257423 12084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "be7554e806fd43d4aab2305e7dbb7674"
format_stamp: "Formatted at 2026-08-08 08:34:15 on dist-test-slave-chsk"
server_key: "39187197d9ebf0e957fbf70a623d9b63"
server_key_iv: "d59e230944d267f0709cac2b8e84ba02"
server_key_version: "encryptionkey@0"
I20260808 08:34:15.257637 12084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:15.279265 12084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:15.286024 12084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:15.286345 12084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:15.287472 12084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:15.288851 12084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:15.288930 12084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:15.289085 12084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:15.289146 12084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:15.324365 12084 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:36959
I20260808 08:34:15.324455 12219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:36959 every 8 connection(s)
I20260808 08:34:15.325682 12084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:34:15.327980 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 12084
I20260808 08:34:15.328161 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:34:15.328640 5779 external_mini_cluster.cc:1428] Setting key 13325bbdf3c1dac37dd1dd204817b149
Aug 08 08:34:15 dist-test-slave-chsk krb5kdc[11826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:34:15.349903 12225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:15.329492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:52241 (local address 127.5.164.254:44241)
0808 08:34:15.330744 (+ 1252us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:15.330749 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:15.330771 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:34:15.332817 (+ 2046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:15.332821 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:15.332884 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:15.332976 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:15.335121 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:15.335932 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:15.338392 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:15.338859 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:15.338952 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:15.343697 (+ 4745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:15.343702 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:15.343706 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:15.343740 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:15.346395 (+ 2655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:15.347418 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:15.347422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:15.347424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:15.347554 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:15.348142 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:15.348145 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:15.348147 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:15.348408 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:15.348517 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:15.349434 (+ 917us) server_negotiation.cc:299] Negotiation successful
0808 08:34:15.349613 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1123,"thread_start_us":1004,"threads_started":1}
I20260808 08:34:15.351619 12222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:15.328875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:44241 (local address 127.5.164.194:52241)
0808 08:34:15.329829 (+ 954us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:15.329893 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:15.332513 (+ 2620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:15.333259 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:15.333272 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:15.334112 (+ 840us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:15.334924 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:15.334958 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:15.336093 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:15.336101 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:15.338245 (+ 2144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:15.338263 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:15.339084 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:15.339093 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:15.339453 (+ 360us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:15.340199 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:15.340235 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:15.343442 (+ 3207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:15.346546 (+ 3104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:15.346558 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:15.346578 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:15.347308 (+ 730us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:15.347708 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:15.347716 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:15.347722 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:15.348018 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:15.348539 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:15.348550 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:15.349032 (+ 482us) client_negotiation.cc:769] Sending connection context
0808 08:34:15.349362 (+ 330us) client_negotiation.cc:240] Negotiation successful
0808 08:34:15.350030 (+ 668us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":362,"threads_started":1}
I20260808 08:34:15.353304 12220 heartbeater.cc:347] Connected to a master server at 127.5.164.254:44241
I20260808 08:34:15.353662 12220 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:15.354405 12220 heartbeater.cc:511] Master 127.5.164.254:44241 requested a full tablet report, sending...
I20260808 08:34:15.355970 11873 ts_manager.cc:194] Registered new tserver with Master: be7554e806fd43d4aab2305e7dbb7674 (127.5.164.194:36959)
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
I20260808 08:34:15.356860 11873 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:52241
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:34:15.388456 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:44241
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:40045
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:15.735437 12228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:15.735888 12228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:15.736063 12228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:15.743976 12228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:15.744093 12228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:15.744208 12228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:34:15.754741 12228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:40045
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:44241
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:15.756155 12228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:15.757380 12228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:15.771225 12234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:15.771384 12233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:15.771355 12237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:15.771984 12228 server_base.cc:1034] running on GCE node
I20260808 08:34:15.772614 12228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:15.773507 12228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:15.774751 12228 hybrid_clock.cc:648] HybridClock initialized: now 1786178055774707 us; error 38 us; skew 500 ppm
I20260808 08:34:15.775074 12228 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:15 dist-test-slave-chsk krb5kdc[11826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:15.778350 12228 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:34:15.779950 12228 webserver.cc:460] Webserver started at http://127.5.164.195:46751/ using document root <none> and password file <none>
I20260808 08:34:15.780651 12228 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:15.780802 12228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:15.781116 12228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:15.784164 12228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "8faa5f6fd0344c36ba038881bac9308b"
format_stamp: "Formatted at 2026-08-08 08:34:15 on dist-test-slave-chsk"
server_key: "9fb7299f19d8d925ea8c419d3773fcb9"
server_key_iv: "42f366572021bdb51f715d7cb501ab83"
server_key_version: "encryptionkey@0"
I20260808 08:34:15.784962 12228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "8faa5f6fd0344c36ba038881bac9308b"
format_stamp: "Formatted at 2026-08-08 08:34:15 on dist-test-slave-chsk"
server_key: "9fb7299f19d8d925ea8c419d3773fcb9"
server_key_iv: "42f366572021bdb51f715d7cb501ab83"
server_key_version: "encryptionkey@0"
I20260808 08:34:15.790136 12228 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:34:15.793481 12244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:15.794806 12228 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:34:15.794978 12228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "8faa5f6fd0344c36ba038881bac9308b"
format_stamp: "Formatted at 2026-08-08 08:34:15 on dist-test-slave-chsk"
server_key: "9fb7299f19d8d925ea8c419d3773fcb9"
server_key_iv: "42f366572021bdb51f715d7cb501ab83"
server_key_version: "encryptionkey@0"
I20260808 08:34:15.795234 12228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:15.813571 12228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:15.817800 12228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:15.818113 12228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:15.819124 12228 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:15.820632 12228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:15.820742 12228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:15.820900 12228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:15.820973 12228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:15.833667 12078 heartbeater.cc:503] Master 127.5.164.254:44241 was elected leader, sending a full tablet report...
I20260808 08:34:15.856549 12228 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:34497
I20260808 08:34:15.856649 12367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:34497 every 8 connection(s)
I20260808 08:34:15.857909 12228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:34:15.864356 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 12228
I20260808 08:34:15.864550 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:34:15.865000 5779 external_mini_cluster.cc:1428] Setting key b59d03b533f2f30fc0a66bb71d59d693
Aug 08 08:34:15 dist-test-slave-chsk krb5kdc[11826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:34:15.878650 12370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:15.860501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:53087 (local address 127.5.164.254:44241)
0808 08:34:15.861072 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:15.861077 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:15.861855 (+ 778us) server_negotiation.cc:407] Connection header received
0808 08:34:15.863809 (+ 1954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:15.863815 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:15.863905 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:15.864056 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:15.865756 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:15.866908 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:15.868987 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:15.869400 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:15.869503 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:15.873157 (+ 3654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:15.873162 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:15.873165 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:15.873203 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:15.875838 (+ 2635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:15.876567 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:15.876572 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:15.876574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:15.876695 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:15.877072 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:15.877075 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:15.877077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:15.877340 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:15.877459 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:15.878160 (+ 701us) server_negotiation.cc:299] Negotiation successful
0808 08:34:15.878348 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":257,"threads_started":1}
I20260808 08:34:15.879812 12371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:15.860915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:44241 (local address 127.5.164.195:53087)
0808 08:34:15.861698 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:15.861736 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:15.863522 (+ 1786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:15.864277 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:15.864285 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:15.864899 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:15.865524 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:15.865557 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:15.867099 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:15.867108 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:15.868840 (+ 1732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:15.868854 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:15.869623 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:15.869629 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:15.869817 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:15.870509 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:15.870539 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:15.872963 (+ 2424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:15.875982 (+ 3019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:15.875988 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:15.876001 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:15.876441 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:15.876788 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:15.876791 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:15.876793 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:15.876973 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:15.877494 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:15.877500 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:15.877828 (+ 328us) client_negotiation.cc:769] Sending connection context
0808 08:34:15.878066 (+ 238us) client_negotiation.cc:240] Negotiation successful
0808 08:34:15.878474 (+ 408us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":296,"threads_started":1}
I20260808 08:34:15.881215 12368 heartbeater.cc:347] Connected to a master server at 127.5.164.254:44241
I20260808 08:34:15.881476 12368 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:15.882177 12368 heartbeater.cc:511] Master 127.5.164.254:44241 requested a full tablet report, sending...
I20260808 08:34:15.883553 11873 ts_manager.cc:194] Registered new tserver with Master: 8faa5f6fd0344c36ba038881bac9308b (127.5.164.195:34497)
I20260808 08:34:15.884312 11873 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:53087
I20260808 08:34:15.893774 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/test-admin.keytab.
Aug 08 08:34:15 dist-test-slave-chsk krb5kdc[11826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:15.926298 5779 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 08:34:15.931614 12377 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:15.929110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37636 (local address 127.5.164.193:32923)
0808 08:34:15.929796 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:15.929803 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:15.929830 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:34:15.929892 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:15.929898 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:15.930104 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:15.930235 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:15.931238 (+ 1003us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37636: BlockingRecv error: recv got EOF from 127.0.0.1:37636 (error 108)
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":357,"threads_started":1}
W20260808 08:34:15.931774 5779 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/krb5cc' of type FILE
Aug 08 08:34:15 dist-test-slave-chsk krb5kdc[11826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:15.934024 5779 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 08:34:15 dist-test-slave-chsk krb5kdc[11826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:15.935451 5779 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 08:34:15 dist-test-slave-chsk krb5kdc[11826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:34:15.950563 12377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:15.937013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37642 (local address 127.5.164.193:32923)
0808 08:34:15.937164 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:15.937169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:15.937427 (+ 258us) server_negotiation.cc:407] Connection header received
0808 08:34:15.937576 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:15.937580 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:15.937635 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:15.937723 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:15.938681 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:15.939697 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:15.941002 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:15.941612 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:15.941717 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:15.945403 (+ 3686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:15.945414 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:15.945428 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:15.945462 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:15.948161 (+ 2699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:15.948774 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:15.948781 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:15.948783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:15.948900 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:15.949244 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:15.949248 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:15.949251 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:15.949619 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:15.949839 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:15.950107 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 08:34:15.950299 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 08:34:15.956463 12377 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:15.954530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37656 (local address 127.5.164.193:32923)
0808 08:34:15.954747 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:15.954754 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:15.955025 (+ 271us) server_negotiation.cc:407] Connection header received
0808 08:34:15.955292 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:15.955298 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:15.955378 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:15.955479 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:15.956240 (+ 761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37656: BlockingRecv error: recv got EOF from 127.0.0.1:37656 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260808 08:34:15.956714 5779 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/krb5cc' of type FILE
Aug 08 08:34:15 dist-test-slave-chsk krb5kdc[11826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:15.958179 5779 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 08:34:15 dist-test-slave-chsk krb5kdc[11826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:15.959551 5779 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 08:34:15 dist-test-slave-chsk krb5kdc[11826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:34:15.973650 12377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:15.960773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37672 (local address 127.5.164.193:32923)
0808 08:34:15.960972 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:15.960980 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:15.961286 (+ 306us) server_negotiation.cc:407] Connection header received
0808 08:34:15.961456 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:15.961461 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:15.961528 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:15.961621 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:15.962645 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:15.963423 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:15.964637 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:15.965066 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:15.965215 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:15.968724 (+ 3509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:15.968735 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:15.968738 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:15.968767 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:15.971134 (+ 2367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:15.971821 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:15.971827 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:15.971831 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:15.971962 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:15.972353 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:15.972359 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:15.972362 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:15.972627 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:15.972885 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:15.973191 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 08:34:15.973392 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 08:34:15.978155 12377 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:15.976460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37680 (local address 127.5.164.193:32923)
0808 08:34:15.976670 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:15.976676 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:15.976847 (+ 171us) server_negotiation.cc:407] Connection header received
0808 08:34:15.977052 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:15.977057 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:15.977142 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:15.977242 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:15.977928 (+ 686us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37680: BlockingRecv error: recv got EOF from 127.0.0.1:37680 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260808 08:34:15.978744 5779 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/krb5cc' of type FILE: Runtime error: Bad format in credentials cache (filename: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786178004478096-5779-0/krb5kdc/krb5cc)
Aug 08 08:34:15 dist-test-slave-chsk krb5kdc[11826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:15.980381 5779 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 08:34:15 dist-test-slave-chsk krb5kdc[11826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:15.981664 5779 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 08:34:15 dist-test-slave-chsk krb5kdc[11826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:34:15.995936 12377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:15.982905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37690 (local address 127.5.164.193:32923)
0808 08:34:15.983120 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:15.983125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:15.983373 (+ 248us) server_negotiation.cc:407] Connection header received
0808 08:34:15.983571 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:15.983575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:15.983628 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:15.983726 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:15.984690 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:15.985395 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:15.986610 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:15.987015 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:15.987149 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:15.990710 (+ 3561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:15.990715 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:15.990718 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:15.990748 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:15.993417 (+ 2669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:15.994114 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:15.994117 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:15.994120 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:15.994276 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:15.994591 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:15.994594 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:15.994596 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:15.994866 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:15.995089 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:15.995408 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 08:34:15.995614 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 08:34:15.997537 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 11940
I20260808 08:34:16.009910 12377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:15.998240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37706 (local address 127.5.164.193:32923)
0808 08:34:15.998451 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:15.998456 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:15.998759 (+ 303us) server_negotiation.cc:407] Connection header received
0808 08:34:15.998907 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:15.998912 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:15.999002 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:15.999111 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:16.000314 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:16.000955 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:16.002156 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:16.002561 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:16.002651 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:16.004691 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:16.004696 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:16.004699 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:16.004729 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:16.007459 (+ 2730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:16.008112 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:16.008116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:16.008119 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:16.008251 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:16.008585 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:16.008588 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:16.008590 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:16.008851 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:16.009118 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:16.009356 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 08:34:16.009557 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:34:16.010499 12072 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:16.094702 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 11940
I20260808 08:34:16.113857 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 12084
Aug 08 08:34:16 dist-test-slave-chsk krb5kdc[11826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:34:16.130700 12392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:16.114850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32916 (local address 127.5.164.194:36959)
0808 08:34:16.115479 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:16.115486 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:16.115512 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:34:16.115575 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:16.115581 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:16.115804 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:16.115979 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:16.117394 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:16.118816 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:16.120219 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:16.120787 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:16.120895 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:16.125081 (+ 4186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:16.125093 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:16.125110 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:16.125161 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:16.128052 (+ 2891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:16.128721 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:16.128728 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:16.128730 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:16.128859 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:16.129206 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:16.129209 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:16.129210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:16.129546 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:16.129800 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:16.130070 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 08:34:16.130368 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":364,"threads_started":1}
I20260808 08:34:16.132226 12214 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:16.222616 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 12084
I20260808 08:34:16.241616 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 12228
Aug 08 08:34:16 dist-test-slave-chsk krb5kdc[11826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178055, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:34:16.258319 12394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:16.242744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51328 (local address 127.5.164.195:34497)
0808 08:34:16.243535 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:16.243543 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:16.243574 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:34:16.243642 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:16.243648 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:16.243854 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:16.243989 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:16.245096 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:16.246202 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:16.247709 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:16.248326 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:16.248446 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:16.252619 (+ 4173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:16.252633 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:16.252648 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:16.252687 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:16.255664 (+ 2977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:16.256386 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:16.256394 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:16.256396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:16.256530 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:16.256907 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:16.256910 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:16.256912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:16.257256 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:16.257498 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:16.257813 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 08:34:16.258020 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":469,"threads_started":1}
I20260808 08:34:16.259764 12363 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:16.344239 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 12228
I20260808 08:34:16.363996 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 11840
I20260808 08:34:16.365242 11903 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:16.472529 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 11840
2026-08-08T08:34:16Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4198 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:16 dist-test-slave-chsk krb5kdc[12399](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:16 dist-test-slave-chsk krb5kdc[12399](info): set up 2 sockets
Aug 08 08:34:16 dist-test-slave-chsk krb5kdc[12399](info): commencing operation
krb5kdc: starting...
W20260808 08:34:17.623780 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.000s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:34:17 dist-test-slave-chsk krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:17Z Disabled control of system clock
WARNING: no policy specified for oryx/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.254.keytab.
Entry for principal oryx/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.254.keytab.
I20260808 08:34:17.883206 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:34369
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.254.keytab
--principal=oryx/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:34369
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:18.218667 12414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:18.218961 12414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:18.219177 12414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:18.226591 12414 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:18.226768 12414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:18.226897 12414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:18.227000 12414 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:18.227092 12414 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:18.237525 12414 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:34369
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.254.keytab
--principal=oryx/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:34369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:18.238982 12414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:18.240433 12414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:18.253108 12420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:18.253142 12419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:18.253108 12422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:18.256757 12414 server_base.cc:1034] running on GCE node
I20260808 08:34:18.257591 12414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:18.259068 12414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:18.260346 12414 hybrid_clock.cc:648] HybridClock initialized: now 1786178058260295 us; error 33 us; skew 500 ppm
I20260808 08:34:18.260676 12414 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:18 dist-test-slave-chsk krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178058, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:18.263922 12414 init.cc:377] Logged in from keytab as oryx/127.5.164.254@KRBTEST.COM (short username oryx)
I20260808 08:34:18.265578 12414 webserver.cc:460] Webserver started at http://127.5.164.254:46157/ using document root <none> and password file <none>
I20260808 08:34:18.266312 12414 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:18.266462 12414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:18.266788 12414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:18.269928 12414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "6112612728a34903854841302c7d6229"
format_stamp: "Formatted at 2026-08-08 08:34:18 on dist-test-slave-chsk"
server_key: "4a1152d3a1252bd4cef05d7b3d96fed1"
server_key_iv: "a219314cb4d06da8198a45cc43777c64"
server_key_version: "encryptionkey@0"
I20260808 08:34:18.270725 12414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "6112612728a34903854841302c7d6229"
format_stamp: "Formatted at 2026-08-08 08:34:18 on dist-test-slave-chsk"
server_key: "4a1152d3a1252bd4cef05d7b3d96fed1"
server_key_iv: "a219314cb4d06da8198a45cc43777c64"
server_key_version: "encryptionkey@0"
I20260808 08:34:18.276209 12414 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260808 08:34:18.279846 12429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:18.281178 12414 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:34:18.281380 12414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "6112612728a34903854841302c7d6229"
format_stamp: "Formatted at 2026-08-08 08:34:18 on dist-test-slave-chsk"
server_key: "4a1152d3a1252bd4cef05d7b3d96fed1"
server_key_iv: "a219314cb4d06da8198a45cc43777c64"
server_key_version: "encryptionkey@0"
I20260808 08:34:18.281594 12414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:18.299484 12414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:18.303828 12414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:18.304145 12414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:18.323943 12414 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:34369
I20260808 08:34:18.323987 12488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:34369 every 8 connection(s)
I20260808 08:34:18.325412 12414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:18.328980 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 12414
I20260808 08:34:18.329232 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:34:18.329711 12489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:18.330137 5779 external_mini_cluster.cc:1428] Setting key 603b78f98b0f01fee4da775117bcd4fb
I20260808 08:34:18.345258 12489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229: Bootstrap starting.
Aug 08 08:34:18 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM
I20260808 08:34:18.349242 12489 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:18.350693 12489 log.cc:824] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:18.354476 12489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229: No bootstrap required, opened a new log
I20260808 08:34:18.355994 12493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:18.332407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49740 (local address 127.5.164.254:34369)
0808 08:34:18.333351 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:18.333367 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:18.333413 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:34:18.335039 (+ 1626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:18.335062 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:18.335573 (+ 511us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:18.335926 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:18.337869 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:18.339263 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:18.341030 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:18.341739 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:18.341874 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:18.346919 (+ 5045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:18.346930 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:18.346950 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:18.347008 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:18.351072 (+ 4064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:18.352071 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:18.352078 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:18.352084 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:18.352285 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:18.352674 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:18.352679 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:18.352682 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:18.353378 (+ 696us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:18.353690 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:18.354038 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 08:34:18.354492 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":727,"thread_start_us":474,"threads_started":1}
I20260808 08:34:18.363407 12489 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } }
I20260808 08:34:18.363770 12489 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:18.363847 12489 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6112612728a34903854841302c7d6229, State: Initialized, Role: FOLLOWER
I20260808 08:34:18.364391 12489 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } }
I20260808 08:34:18.364650 12489 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:18.364811 12489 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:18.365007 12489 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:18.367326 12489 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } }
I20260808 08:34:18.367882 12489 leader_election.cc:302] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6112612728a34903854841302c7d6229; no voters:
I20260808 08:34:18.368520 12489 leader_election.cc:288] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:18.368690 12495 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:18.369390 12495 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [term 1 LEADER]: Becoming Leader. State: Replica: 6112612728a34903854841302c7d6229, State: Running, Role: LEADER
I20260808 08:34:18.369976 12495 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } }
I20260808 08:34:18.370817 12489 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:18.373067 12497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6112612728a34903854841302c7d6229. Latest consensus state: current_term: 1 leader_uuid: "6112612728a34903854841302c7d6229" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } }
I20260808 08:34:18.373445 12497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:18.373170 12496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6112612728a34903854841302c7d6229" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } }
I20260808 08:34:18.373611 12496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:18.375962 12501 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:18.383401 12501 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:18.395339 12501 catalog_manager.cc:1347] Generated new cluster ID: ca305db4b5824c5791d484e4d6419ff4
I20260808 08:34:18.395485 12501 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:18.416550 12501 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:18.418717 12501 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:18.429076 12501 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229: Generated new TSK 0
I20260808 08:34:18.430226 12501 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.193.keytab.
Entry for principal oryx/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.193.keytab.
I20260808 08:34:18.503453 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:34369
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.193.keytab
--principal=oryx/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:18.841728 12520 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:18.842093 12520 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:18.842262 12520 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:18.849579 12520 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:18.849756 12520 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:18.849948 12520 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:34:18.860518 12520 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.193.keytab
--principal=oryx/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:34369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:18.861907 12520 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:18.863356 12520 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:18.877091 12528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:18.877184 12526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:18.877770 12525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:18.877962 12520 server_base.cc:1034] running on GCE node
I20260808 08:34:18.878744 12520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:18.879792 12520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:18.881040 12520 hybrid_clock.cc:648] HybridClock initialized: now 1786178058881005 us; error 55 us; skew 500 ppm
I20260808 08:34:18.881371 12520 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:18 dist-test-slave-chsk krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178058, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:18.884807 12520 init.cc:377] Logged in from keytab as oryx/127.5.164.193@KRBTEST.COM (short username oryx)
I20260808 08:34:18.886590 12520 webserver.cc:460] Webserver started at http://127.5.164.193:37067/ using document root <none> and password file <none>
I20260808 08:34:18.887424 12520 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:18.887578 12520 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:18.887892 12520 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:18.890856 12520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "71166cb11913487e9305124bfb9c4af5"
format_stamp: "Formatted at 2026-08-08 08:34:18 on dist-test-slave-chsk"
server_key: "5727a5b9156a7e30090de9ac3bedd5ad"
server_key_iv: "22c85071092406a4244d61df520a5d62"
server_key_version: "encryptionkey@0"
I20260808 08:34:18.891664 12520 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "71166cb11913487e9305124bfb9c4af5"
format_stamp: "Formatted at 2026-08-08 08:34:18 on dist-test-slave-chsk"
server_key: "5727a5b9156a7e30090de9ac3bedd5ad"
server_key_iv: "22c85071092406a4244d61df520a5d62"
server_key_version: "encryptionkey@0"
I20260808 08:34:18.897034 12520 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:34:18.900630 12535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:18.901950 12520 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:34:18.902153 12520 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "71166cb11913487e9305124bfb9c4af5"
format_stamp: "Formatted at 2026-08-08 08:34:18 on dist-test-slave-chsk"
server_key: "5727a5b9156a7e30090de9ac3bedd5ad"
server_key_iv: "22c85071092406a4244d61df520a5d62"
server_key_version: "encryptionkey@0"
I20260808 08:34:18.902452 12520 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:18.915283 12520 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:18.919579 12520 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:18.919821 12520 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:18.920735 12520 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:18.922003 12520 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:18.922083 12520 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:18.922168 12520 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:18.922211 12520 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:18.956391 12520 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:46005
I20260808 08:34:18.956439 12661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:46005 every 8 connection(s)
I20260808 08:34:18.957697 12520 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:34:18.960461 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 12520
I20260808 08:34:18.960682 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:34:18.961565 5779 external_mini_cluster.cc:1428] Setting key 7d0d8f933f40541a2327c38611c7ff87
Aug 08 08:34:18 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178058, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM
I20260808 08:34:18.979197 12664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:18.960281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:53911 (local address 127.5.164.254:34369)
0808 08:34:18.960797 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:18.960802 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:18.961957 (+ 1155us) server_negotiation.cc:407] Connection header received
0808 08:34:18.964348 (+ 2391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:18.964354 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:18.964441 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:18.964557 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:18.966006 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:18.966725 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:18.968308 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:18.968735 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:18.968871 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:18.972547 (+ 3676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:18.972552 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:18.972555 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:18.972587 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:18.975374 (+ 2787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:18.976334 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:18.976338 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:18.976340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:18.976528 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:18.977066 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:18.977074 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:18.977081 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:18.977468 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:18.977682 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:18.978414 (+ 732us) server_negotiation.cc:299] Negotiation successful
0808 08:34:18.978690 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":284,"threads_started":1}
I20260808 08:34:18.979858 12665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:18.960915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.193:53911)
0808 08:34:18.961800 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:18.961838 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:18.964093 (+ 2255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:18.964796 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:18.964804 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:18.965300 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:18.965833 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:18.965850 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:18.966880 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:18.966890 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:18.968153 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:18.968165 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:18.968975 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:18.968982 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:18.969217 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:18.969940 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:18.969962 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:18.972330 (+ 2368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:18.975517 (+ 3187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:18.975525 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:18.975541 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:18.976171 (+ 630us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:18.976662 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:18.976667 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:18.976671 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:18.976903 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:18.977624 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:18.977630 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:18.977970 (+ 340us) client_negotiation.cc:769] Sending connection context
0808 08:34:18.978250 (+ 280us) client_negotiation.cc:240] Negotiation successful
0808 08:34:18.978636 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":328,"threads_started":1}
I20260808 08:34:18.981390 12662 heartbeater.cc:347] Connected to a master server at 127.5.164.254:34369
I20260808 08:34:18.981726 12662 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:18.982422 12662 heartbeater.cc:511] Master 127.5.164.254:34369 requested a full tablet report, sending...
I20260808 08:34:18.984486 12450 ts_manager.cc:194] Registered new tserver with Master: 71166cb11913487e9305124bfb9c4af5 (127.5.164.193:46005)
I20260808 08:34:18.986069 12450 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:53911
WARNING: no policy specified for oryx/127.5.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.194.keytab.
Entry for principal oryx/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.194.keytab.
I20260808 08:34:19.018747 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:34369
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.194.keytab
--principal=oryx/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:19.357686 12670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:19.357963 12670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:19.358069 12670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:19.365530 12670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:19.365638 12670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:19.365754 12670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:34:19.375806 12670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.194.keytab
--principal=oryx/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:34369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:19.377125 12670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:19.378494 12670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:19.392765 12677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:19.392760 12678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:19.392795 12680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:19.393708 12670 server_base.cc:1034] running on GCE node
I20260808 08:34:19.394373 12670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:19.395393 12670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:19.396634 12670 hybrid_clock.cc:648] HybridClock initialized: now 1786178059396575 us; error 64 us; skew 500 ppm
I20260808 08:34:19.396958 12670 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:19 dist-test-slave-chsk krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178059, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:19.400336 12670 init.cc:377] Logged in from keytab as oryx/127.5.164.194@KRBTEST.COM (short username oryx)
I20260808 08:34:19.401795 12670 webserver.cc:460] Webserver started at http://127.5.164.194:41305/ using document root <none> and password file <none>
I20260808 08:34:19.402514 12670 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:19.402662 12670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:19.402971 12670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:19.405982 12670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "7e7d7176562845f2a739ccf88f8366ec"
format_stamp: "Formatted at 2026-08-08 08:34:19 on dist-test-slave-chsk"
server_key: "f7029a32fc330d5baea6897c39eb4779"
server_key_iv: "fd1c54dccaf9605d61e33ad70bc4c902"
server_key_version: "encryptionkey@0"
I20260808 08:34:19.406790 12670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "7e7d7176562845f2a739ccf88f8366ec"
format_stamp: "Formatted at 2026-08-08 08:34:19 on dist-test-slave-chsk"
server_key: "f7029a32fc330d5baea6897c39eb4779"
server_key_iv: "fd1c54dccaf9605d61e33ad70bc4c902"
server_key_version: "encryptionkey@0"
I20260808 08:34:19.412504 12670 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 08:34:19.416124 12689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:19.417482 12670 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:34:19.417673 12670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "7e7d7176562845f2a739ccf88f8366ec"
format_stamp: "Formatted at 2026-08-08 08:34:19 on dist-test-slave-chsk"
server_key: "f7029a32fc330d5baea6897c39eb4779"
server_key_iv: "fd1c54dccaf9605d61e33ad70bc4c902"
server_key_version: "encryptionkey@0"
I20260808 08:34:19.417886 12670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:19.445333 12670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:19.450047 12670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:19.450378 12670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:19.451495 12670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:19.452970 12670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:19.453094 12670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:19.453250 12670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:19.453325 12670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:19.487998 12670 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:35373
I20260808 08:34:19.488036 12808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:35373 every 8 connection(s)
I20260808 08:34:19.489284 12670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:34:19.494936 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 12670
I20260808 08:34:19.495160 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:34:19.495764 5779 external_mini_cluster.cc:1428] Setting key dd28b018d6192771848ca35613c16d53
Aug 08 08:34:19 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178059, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM
I20260808 08:34:19.510931 12812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:19.491980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:42291 (local address 127.5.164.254:34369)
0808 08:34:19.492408 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:19.492413 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:19.493413 (+ 1000us) server_negotiation.cc:407] Connection header received
0808 08:34:19.495742 (+ 2329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:19.495746 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:19.495813 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:19.495949 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:19.497712 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:19.498410 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:19.500001 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:19.500422 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:19.500568 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:19.504646 (+ 4078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:19.504651 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:19.504655 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:19.504688 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:19.507522 (+ 2834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:19.508519 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:19.508531 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:19.508534 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:19.508665 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:19.509134 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:19.509143 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:19.509145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:19.509421 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:19.509585 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:19.510307 (+ 722us) server_negotiation.cc:299] Negotiation successful
0808 08:34:19.510543 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":203,"threads_started":1}
I20260808 08:34:19.511987 12813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:19.492537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.194:42291)
0808 08:34:19.493246 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:19.493289 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:19.495433 (+ 2144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:19.496188 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:19.496196 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:19.496867 (+ 671us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:19.497544 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:19.497565 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:19.498566 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:19.498574 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:19.499852 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:19.499864 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:19.500648 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:19.500655 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:19.500890 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:19.501590 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:19.501613 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:19.504412 (+ 2799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:19.507710 (+ 3298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:19.507719 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:19.507748 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:19.508384 (+ 636us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:19.508793 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:19.508798 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:19.508802 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:19.509001 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:19.509559 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:19.509566 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:19.509905 (+ 339us) client_negotiation.cc:769] Sending connection context
0808 08:34:19.510178 (+ 273us) client_negotiation.cc:240] Negotiation successful
0808 08:34:19.510750 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":277,"threads_started":1}
I20260808 08:34:19.513586 12810 heartbeater.cc:347] Connected to a master server at 127.5.164.254:34369
I20260808 08:34:19.513908 12810 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:19.514658 12810 heartbeater.cc:511] Master 127.5.164.254:34369 requested a full tablet report, sending...
I20260808 08:34:19.516273 12450 ts_manager.cc:194] Registered new tserver with Master: 7e7d7176562845f2a739ccf88f8366ec (127.5.164.194:35373)
I20260808 08:34:19.517122 12450 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:42291
WARNING: no policy specified for oryx/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.195.keytab.
Entry for principal oryx/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.195.keytab.
I20260808 08:34:19.555043 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:34369
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.195.keytab
--principal=oryx/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:19.894547 12817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:19.894878 12817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:19.895047 12817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:19.902290 12817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:19.902469 12817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:19.902649 12817 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:34:19.914129 12817 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.195.keytab
--principal=oryx/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:34369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:19.915582 12817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:19.916910 12817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:19.930083 12822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:19.930096 12823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:19.930318 12826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:19.930847 12817 server_base.cc:1034] running on GCE node
I20260808 08:34:19.931531 12817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:19.932461 12817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:19.933705 12817 hybrid_clock.cc:648] HybridClock initialized: now 1786178059933666 us; error 53 us; skew 500 ppm
I20260808 08:34:19.934073 12817 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:19 dist-test-slave-chsk krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178059, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:19.937314 12817 init.cc:377] Logged in from keytab as oryx/127.5.164.195@KRBTEST.COM (short username oryx)
I20260808 08:34:19.938696 12817 webserver.cc:460] Webserver started at http://127.5.164.195:38425/ using document root <none> and password file <none>
I20260808 08:34:19.939414 12817 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:19.939524 12817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:19.939774 12817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:19.942605 12817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe"
format_stamp: "Formatted at 2026-08-08 08:34:19 on dist-test-slave-chsk"
server_key: "01eb89c61e5f7e17be42334619a20d31"
server_key_iv: "a99df970f199b9f3e72de833c9b9fae7"
server_key_version: "encryptionkey@0"
I20260808 08:34:19.943378 12817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe"
format_stamp: "Formatted at 2026-08-08 08:34:19 on dist-test-slave-chsk"
server_key: "01eb89c61e5f7e17be42334619a20d31"
server_key_iv: "a99df970f199b9f3e72de833c9b9fae7"
server_key_version: "encryptionkey@0"
I20260808 08:34:19.948308 12817 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:34:19.951574 12833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:19.952864 12817 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:34:19.953037 12817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe"
format_stamp: "Formatted at 2026-08-08 08:34:19 on dist-test-slave-chsk"
server_key: "01eb89c61e5f7e17be42334619a20d31"
server_key_iv: "a99df970f199b9f3e72de833c9b9fae7"
server_key_version: "encryptionkey@0"
I20260808 08:34:19.953235 12817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:19.988996 12662 heartbeater.cc:503] Master 127.5.164.254:34369 was elected leader, sending a full tablet report...
I20260808 08:34:19.992360 12817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:19.996546 12817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:19.996869 12817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:19.997885 12817 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:19.999281 12817 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:19.999354 12817 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:19.999503 12817 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:19.999588 12817 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:20.033550 12817 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:36121
I20260808 08:34:20.033604 12951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:36121 every 8 connection(s)
I20260808 08:34:20.034830 12817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:34:20.040594 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 12817
I20260808 08:34:20.040799 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:34:20.041271 5779 external_mini_cluster.cc:1428] Setting key 2bc1a3ec3475543d9468196c3388271b
Aug 08 08:34:20 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178059, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM
I20260808 08:34:20.054710 12954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.037338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:56059 (local address 127.5.164.254:34369)
0808 08:34:20.037854 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:20.037858 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:20.038623 (+ 765us) server_negotiation.cc:407] Connection header received
0808 08:34:20.040604 (+ 1981us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:20.040609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:20.040701 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:20.040840 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:20.042688 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.043846 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.045453 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.045846 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.045942 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.049267 (+ 3325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:20.049271 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:20.049274 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:20.049306 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:20.052052 (+ 2746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.052678 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.052682 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.052684 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.052796 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.053182 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.053185 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.053187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.053431 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:20.053547 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:20.054186 (+ 639us) server_negotiation.cc:299] Negotiation successful
0808 08:34:20.054352 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":276,"threads_started":1}
I20260808 08:34:20.055864 12955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.037780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.195:56059)
0808 08:34:20.038457 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:20.038495 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:20.040270 (+ 1775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:20.041072 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:20.041081 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:20.041645 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:20.042344 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:20.042364 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.044017 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.044045 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:20.045325 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:20.045338 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.046051 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.046056 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:20.046246 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.046860 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:20.046881 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:20.049080 (+ 2199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:20.052181 (+ 3101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:20.052187 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:20.052198 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:20.052583 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:20.052888 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:20.052891 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:20.052893 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:20.053079 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:20.053559 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:20.053565 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:20.053846 (+ 281us) client_negotiation.cc:769] Sending connection context
0808 08:34:20.054104 (+ 258us) client_negotiation.cc:240] Negotiation successful
0808 08:34:20.054488 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":274,"threads_started":1}
I20260808 08:34:20.057369 12952 heartbeater.cc:347] Connected to a master server at 127.5.164.254:34369
I20260808 08:34:20.057677 12952 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:20.058449 12952 heartbeater.cc:511] Master 127.5.164.254:34369 requested a full tablet report, sending...
I20260808 08:34:20.059863 12450 ts_manager.cc:194] Registered new tserver with Master: d4cd6c8e012a4cc4b068ad77bc765cfe (127.5.164.195:36121)
I20260808 08:34:20.060632 12450 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:56059
I20260808 08:34:20.069108 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.5.164.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.164.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.164.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.253.keytab.
Entry for principal oryx/127.5.164.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.253.keytab.
I20260808 08:34:20.127342 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.253:38329
--webserver_interface=127.5.164.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.253.keytab
--principal=oryx/127.5.164.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:34369,127.5.164.253:38329
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:20.459934 12958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:20.460238 12958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:20.460332 12958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:20.467695 12958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:20.467815 12958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:20.467862 12958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:20.467921 12958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:20.467969 12958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:20.479108 12958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:34369,127.5.164.253:38329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.253.keytab
--principal=oryx/127.5.164.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.253:38329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.5.164.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
W20260808 08:34:20.479533 12958 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.5.164.254:34369,127.5.164.253:38329'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 08:34:20.480680 12958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:20.482013 12958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:20.493927 12965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:20.494426 12967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:20.494426 12964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:20.495097 12958 server_base.cc:1034] running on GCE node
I20260808 08:34:20.495896 12958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:20.497279 12958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:20.498548 12958 hybrid_clock.cc:648] HybridClock initialized: now 1786178060498467 us; error 51 us; skew 500 ppm
I20260808 08:34:20.498891 12958 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:20 dist-test-slave-chsk krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178060, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:20.505038 12958 init.cc:377] Logged in from keytab as oryx/127.5.164.253@KRBTEST.COM (short username oryx)
I20260808 08:34:20.506537 12958 webserver.cc:460] Webserver started at http://127.5.164.253:35765/ using document root <none> and password file <none>
I20260808 08:34:20.507413 12958 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:20.507555 12958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:20.507941 12958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:20.511024 12958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/data/instance:
uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d"
format_stamp: "Formatted at 2026-08-08 08:34:20 on dist-test-slave-chsk"
server_key: "f81d7c88b9a17423fb94bddbd602368b"
server_key_iv: "6b48e5ce71efb9cc009079beb3ca4ea7"
server_key_version: "encryptionkey@0"
I20260808 08:34:20.511935 12958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/wal/instance:
uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d"
format_stamp: "Formatted at 2026-08-08 08:34:20 on dist-test-slave-chsk"
server_key: "f81d7c88b9a17423fb94bddbd602368b"
server_key_iv: "6b48e5ce71efb9cc009079beb3ca4ea7"
server_key_version: "encryptionkey@0"
I20260808 08:34:20.517120 12958 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:34:20.519917 12810 heartbeater.cc:503] Master 127.5.164.254:34369 was elected leader, sending a full tablet report...
I20260808 08:34:20.520680 12975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:20.522262 12958 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:34:20.522480 12958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/wal
uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d"
format_stamp: "Formatted at 2026-08-08 08:34:20 on dist-test-slave-chsk"
server_key: "f81d7c88b9a17423fb94bddbd602368b"
server_key_iv: "6b48e5ce71efb9cc009079beb3ca4ea7"
server_key_version: "encryptionkey@0"
I20260808 08:34:20.522716 12958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:20.549085 12958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:20.553608 12958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:20.553911 12958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:20.573402 12958 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.253:38329
I20260808 08:34:20.573421 13028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.253:38329 every 8 connection(s)
I20260808 08:34:20.574785 12958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/data/info.pb
I20260808 08:34:20.578780 13029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:20.581815 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 12958
I20260808 08:34:20.586658 13029 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:34:20 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.164.253@KRBTEST.COM
Aug 08 08:34:20 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178060, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.253@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM
I20260808 08:34:20.604911 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.590303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49754 (local address 127.5.164.254:34369)
0808 08:34:20.591523 (+ 1220us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:20.591527 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:20.591542 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:34:20.591600 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:20.591604 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:20.591679 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:20.591804 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:20.592914 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.593638 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.595017 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.595478 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.595631 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.599003 (+ 3372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:20.599015 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:20.599019 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:20.599056 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:20.601966 (+ 2910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.602700 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.602706 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.602710 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.602839 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.603258 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.603265 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.603268 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.603602 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:20.603762 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:20.604292 (+ 530us) server_negotiation.cc:299] Negotiation successful
0808 08:34:20.604535 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1123,"thread_start_us":1035,"threads_started":1}
I20260808 08:34:20.605734 13033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.590235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.0.0.1:49754)
0808 08:34:20.590971 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:20.591011 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:20.591190 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:20.591869 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:20.591876 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:20.592506 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:20.592750 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:20.592759 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.593780 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.593788 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:20.594862 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:20.594873 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.595740 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.595749 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:20.595890 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.596510 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:20.596536 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:20.598808 (+ 2272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:20.602127 (+ 3319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:20.602138 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:20.602150 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:20.602574 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:20.602951 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:20.602956 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:20.602960 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:20.603115 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:20.603737 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:20.603745 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:20.603943 (+ 198us) client_negotiation.cc:769] Sending connection context
0808 08:34:20.604198 (+ 255us) client_negotiation.cc:240] Negotiation successful
0808 08:34:20.604791 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"mutex_wait_us":159,"thread_start_us":306,"threads_started":1}
I20260808 08:34:20.605769 13032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.584238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52436 (local address 127.5.164.253:38329)
0808 08:34:20.585054 (+ 816us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:20.585070 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:20.585122 (+ 52us) server_negotiation.cc:407] Connection header received
0808 08:34:20.587413 (+ 2291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:20.587442 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:20.588001 (+ 559us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:20.588451 (+ 450us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:20.589891 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.591879 (+ 1988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.593182 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.593810 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.594060 (+ 250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.598671 (+ 4611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:20.598679 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:20.598690 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:20.598726 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:20.601458 (+ 2732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.602242 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.602255 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.602257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.602415 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.602816 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.602823 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.602827 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.603432 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:20.603748 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:20.604157 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 08:34:20.604629 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":586,"thread_start_us":363,"threads_started":1}
I20260808 08:34:20.607811 13029 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:34:20 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178060, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.253@KRBTEST.COM for oryx/127.5.164.253@KRBTEST.COM
I20260808 08:34:20.619891 13033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.608514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:38329 (local address 127.0.0.1:52450)
0808 08:34:20.608730 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:20.608748 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:20.608846 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:20.609288 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:20.609292 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:20.609605 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:20.609734 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:20.609741 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.610647 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.610651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:20.611547 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:20.611558 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.612184 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.612187 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:20.612335 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.612904 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:20.612920 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:20.614976 (+ 2056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:20.617803 (+ 2827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:20.617807 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:20.617828 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:20.618215 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:20.618525 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:20.618528 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:20.618530 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:20.618650 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:20.619099 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:20.619102 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:20.619293 (+ 191us) client_negotiation.cc:769] Sending connection context
0808 08:34:20.619403 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 08:34:20.619606 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 08:34:20.619966 13032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.608733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52450 (local address 127.5.164.253:38329)
0808 08:34:20.609062 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:20.609067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:20.609081 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:34:20.609116 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:20.609119 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:20.609167 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:20.609238 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:20.609848 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.610510 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.611668 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.612061 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.612163 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.615246 (+ 3083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:20.615250 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:20.615254 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:20.615282 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:20.617686 (+ 2404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.618309 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.618313 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.618315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.618430 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.618738 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.618741 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.618743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.618994 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:20.619100 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:20.619484 (+ 384us) server_negotiation.cc:299] Negotiation successful
0808 08:34:20.619729 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":75,"server-negotiator.queue_time_us":234}
I20260808 08:34:20.624838 13029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: Bootstrap starting.
I20260808 08:34:20.628238 13029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:20.629261 13029 log.cc:824] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:20.632161 13029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: No bootstrap required, opened a new log
I20260808 08:34:20.639123 13029 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } }
I20260808 08:34:20.639600 13029 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:20.639716 13029 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c12fe6dcbfe4ab88b0adbaa077dc67d, State: Initialized, Role: FOLLOWER
I20260808 08:34:20.640313 13029 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } }
I20260808 08:34:20.641185 13037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } } }
I20260808 08:34:20.641465 13037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:20.642225 13029 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: configured and running, proceeding with master startup.
W20260808 08:34:20.650810 13049 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:34:20.650959 13049 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:34:20.654510 12958 master_runner.cc:428] Detected that this master 9c12fe6dcbfe4ab88b0adbaa077dc67d is joining an existing cluster
I20260808 08:34:20.654628 12958 master_runner.cc:432] Initiating AddMaster RPC to add 127.5.164.253:38329
I20260808 08:34:20.678691 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.658710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49758 (local address 127.5.164.254:34369)
0808 08:34:20.658921 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:20.658927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:20.659643 (+ 716us) server_negotiation.cc:407] Connection header received
0808 08:34:20.659942 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:20.659951 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:20.660098 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:20.660193 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:20.662263 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.663787 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.666649 (+ 2862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.667626 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.667759 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.670342 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:20.670349 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:20.670353 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:20.670396 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:20.674080 (+ 3684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.674827 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.674832 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.674837 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.675006 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.675537 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.675545 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.675549 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.675972 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:20.676169 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:20.677944 (+ 1775us) server_negotiation.cc:299] Negotiation successful
0808 08:34:20.678246 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:34:20.679016 13055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.658721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.0.0.1:49758)
0808 08:34:20.659537 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:20.659563 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:20.659760 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:20.660483 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:20.660491 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:20.661474 (+ 983us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:20.662016 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:20.662035 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.664041 (+ 2006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.664050 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:20.666406 (+ 2356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:20.666428 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.668184 (+ 1756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.668194 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:20.668453 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.669271 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:20.669300 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:20.670114 (+ 814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:20.674223 (+ 4109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:20.674228 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:20.674236 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:20.674676 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:20.675169 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:20.675176 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:20.675181 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:20.675390 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:20.676255 (+ 865us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:20.676263 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:20.676542 (+ 279us) client_negotiation.cc:769] Sending connection context
0808 08:34:20.676800 (+ 258us) client_negotiation.cc:240] Negotiation successful
0808 08:34:20.677251 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":445,"threads_started":1}
I20260808 08:34:20.689785 13032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.660085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52462 (local address 127.5.164.253:38329)
0808 08:34:20.660796 (+ 711us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:20.660806 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:20.670646 (+ 9840us) server_negotiation.cc:407] Connection header received
0808 08:34:20.670835 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:20.670841 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:20.670902 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:20.670969 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:20.672446 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.673566 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.675641 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.676546 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.676665 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.680744 (+ 4079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:20.680752 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:20.680759 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:20.680798 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:20.685073 (+ 4275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.686103 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.686110 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.686116 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.686353 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.686834 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.686841 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.686846 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.687299 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:20.687446 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:20.689067 (+ 1621us) server_negotiation.cc:299] Negotiation successful
0808 08:34:20.689342 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601}
I20260808 08:34:20.691076 13056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.659770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:38329 (local address 127.0.0.1:52462)
0808 08:34:20.670547 (+ 10777us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:20.670574 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:20.670730 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:20.671251 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:20.671254 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:20.671923 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:20.672284 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:20.672300 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.673780 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.673786 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:20.675460 (+ 1674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:20.675476 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.676983 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.676990 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:20.677185 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.679326 (+ 2141us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:20.679353 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:20.680558 (+ 1205us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:20.685272 (+ 4714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:20.685280 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:20.685287 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:20.685974 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:20.686528 (+ 554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:20.686535 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:20.686541 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:20.686720 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:20.687518 (+ 798us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:20.687525 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:20.688713 (+ 1188us) client_negotiation.cc:769] Sending connection context
0808 08:34:20.690125 (+ 1412us) client_negotiation.cc:240] Negotiation successful
0808 08:34:20.690467 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10617,"thread_start_us":9250,"threads_started":1}
WARNING: no policy specified for oryx/127.5.164.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.164.252@KRBTEST.COM" created.
Aug 08 08:34:20 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178058, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.254@KRBTEST.COM for oryx/127.5.164.253@KRBTEST.COM
I20260808 08:34:20.716226 13032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.687330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52468 (local address 127.5.164.253:38329)
0808 08:34:20.690079 (+ 2749us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:20.690087 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:20.692029 (+ 1942us) server_negotiation.cc:407] Connection header received
0808 08:34:20.692781 (+ 752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:20.692787 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:20.692919 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:20.692995 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:20.694908 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.696081 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.697589 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.698308 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.698441 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.703180 (+ 4739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:20.703188 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:20.703193 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:20.703240 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:20.711901 (+ 8661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.713151 (+ 1250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.713161 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.713168 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.713366 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.713918 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.713925 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.713932 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.714401 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:20.714584 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:20.715520 (+ 936us) server_negotiation.cc:299] Negotiation successful
0808 08:34:20.715805 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2607,"thread_start_us":4913,"threads_started":1}
I20260808 08:34:20.717031 13058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.686915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:38329 (local address 127.0.0.1:52468)
0808 08:34:20.691882 (+ 4967us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:20.691936 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:20.692535 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:20.693334 (+ 799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:20.693343 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:20.694356 (+ 1013us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:20.694705 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:20.694720 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.696251 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.696258 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:20.697433 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:20.697447 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.698509 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.698515 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:20.698747 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.699635 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:20.699666 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:20.702888 (+ 3222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:20.712174 (+ 9286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:20.712199 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:20.712209 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:20.712943 (+ 734us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:20.713533 (+ 590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:20.713539 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:20.713543 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:20.713767 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:20.714705 (+ 938us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:20.714717 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:20.715025 (+ 308us) client_negotiation.cc:769] Sending connection context
0808 08:34:20.715382 (+ 357us) client_negotiation.cc:240] Negotiation successful
0808 08:34:20.716091 (+ 709us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4642,"thread_start_us":4596,"threads_started":1}
I20260808 08:34:20.719533 12450 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.5.164.253:38329: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d"
member_type: NON_VOTER
last_known_addr {
host: "127.5.164.253"
port: 38329
}
attrs {
promote: true
}
}
dest_uuid: "6112612728a34903854841302c7d6229"
cas_config_opid_index: -1
I20260808 08:34:20.721186 12450 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: NON_VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: true } }
I20260808 08:34:20.730537 13063 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 9c12fe6dcbfe4ab88b0adbaa077dc67d (127.5.164.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: NON_VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: true } } }
I20260808 08:34:20.732191 13003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:20.735129 13063 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.5.164.253:38329
I20260808 08:34:20.736840 13062 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6112612728a34903854841302c7d6229" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: NON_VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: true } } }
I20260808 08:34:20.737174 13062 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:20.737221 12958 master.cc:537] Master@127.5.164.253:38329 shutting down...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.164.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.252.keytab.
Entry for principal oryx/127.5.164.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.252.keytab.
I20260808 08:34:20.741214 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.252:35533
--webserver_interface=127.5.164.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.252.keytab
--principal=oryx/127.5.164.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:34369,127.5.164.253:38329,127.5.164.252:35533
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:34:20.737205 13003 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 1 FOLLOWER]: Refusing update from remote peer 6112612728a34903854841302c7d6229: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 08:34:20.751749 13063 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: NON_VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 08:34:20.755715 12433 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 08:34:20.757546 12433 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 -> Peer 9c12fe6dcbfe4ab88b0adbaa077dc67d (127.5.164.253:38329): Couldn't send request to peer 9c12fe6dcbfe4ab88b0adbaa077dc67d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 08:34:20.759299 12958 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:20.759733 12958 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:20.759920 12958 tablet_replica.cc:330] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: stopping tablet replica
I20260808 08:34:20.767086 12958 master.cc:552] Master@127.5.164.253:38329 shutdown complete.
I20260808 08:34:20.767246 12958 master_runner.cc:305] Clearing existing system tablet
I20260808 08:34:20.767743 12958 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:20.767844 12958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:20.770902 12958 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20260808 08:34:20.772758 13068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:20.773104 12958 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:20.773437 12958 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260808 08:34:20.773550 12958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/wal
uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d"
format_stamp: "Formatted at 2026-08-08 08:34:20 on dist-test-slave-chsk"
server_key: "f81d7c88b9a17423fb94bddbd602368b"
server_key_iv: "6b48e5ce71efb9cc009079beb3ca4ea7"
server_key_version: "encryptionkey@0"
I20260808 08:34:20.778997 12958 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:20.786003 12958 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 08:34:20.786238 12958 log.cc:1196] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 08:34:20.786718 12958 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: Deleting consensus metadata
I20260808 08:34:20.787060 12958 master_runner.cc:315] Copying system tablet from 127.5.164.254:34369
I20260808 08:34:20.792977 12958 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: tablet copy: Beginning tablet copy session from remote peer at address 127.5.164.254:34369
I20260808 08:34:20.809818 13075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.794079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.0.0.1:49764)
0808 08:34:20.794620 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:20.794646 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:20.794865 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:20.795354 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:20.795360 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:20.795947 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:20.796246 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:20.796258 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.797786 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.797791 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:20.799302 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:20.799319 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.800387 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.800394 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:20.800584 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.801315 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:20.801340 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:20.802427 (+ 1087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:20.806570 (+ 4143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:20.806576 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:20.806580 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:20.807122 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:20.807617 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:20.807627 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:20.807631 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:20.807804 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:20.808658 (+ 854us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:20.808664 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:20.808849 (+ 185us) client_negotiation.cc:769] Sending connection context
0808 08:34:20.809012 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 08:34:20.809362 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":531,"threads_started":1}
I20260808 08:34:20.810089 13034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:20.794413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49764 (local address 127.5.164.254:34369)
0808 08:34:20.794604 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:20.794610 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:20.794740 (+ 130us) server_negotiation.cc:407] Connection header received
0808 08:34:20.795024 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:20.795030 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:20.795196 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:20.795309 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:20.796427 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.797581 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.799468 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:20.800215 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:20.800364 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:20.802674 (+ 2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:20.802681 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:20.802685 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:20.802730 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:20.806429 (+ 3699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.807278 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.807285 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.807291 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.807478 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:20.807940 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:20.807946 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:20.807951 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:20.808502 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:20.808697 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:20.809171 (+ 474us) server_negotiation.cc:299] Negotiation successful
0808 08:34:20.809592 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:34:20.811417 12472 tablet_copy_service.cc:140] P 6112612728a34903854841302c7d6229: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 9c12fe6dcbfe4ab88b0adbaa077dc67d ({username='oryx', principal='oryx/127.5.164.253@KRBTEST.COM'} at 127.0.0.1:49764)
I20260808 08:34:20.811908 12472 tablet_copy_service.cc:161] P 6112612728a34903854841302c7d6229: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 9c12fe6dcbfe4ab88b0adbaa077dc67d at {username='oryx', principal='oryx/127.5.164.253@KRBTEST.COM'} at 127.0.0.1:49764: session id = 9c12fe6dcbfe4ab88b0adbaa077dc67d-00000000000000000000000000000000
I20260808 08:34:20.817094 12472 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 08:34:20.820117 12958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 08:34:20.827544 12958 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: tablet copy: Starting download of 0 data blocks...
I20260808 08:34:20.827989 12958 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: tablet copy: Starting download of 1 WAL segments...
I20260808 08:34:20.832329 12958 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 08:34:20.837827 12472 tablet_copy_service.cc:342] P 6112612728a34903854841302c7d6229: Request end of tablet copy session 9c12fe6dcbfe4ab88b0adbaa077dc67d-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.5.164.253@KRBTEST.COM'} at 127.0.0.1:49764
I20260808 08:34:20.838155 12472 tablet_copy_service.cc:433] P 6112612728a34903854841302c7d6229: ending tablet copy session 9c12fe6dcbfe4ab88b0adbaa077dc67d-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 9c12fe6dcbfe4ab88b0adbaa077dc67d
I20260808 08:34:20.852805 12958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:20.859611 13076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:20.864883 13077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:20.871698 13079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:20.876652 12958 server_base.cc:1034] running on GCE node
I20260808 08:34:20.877362 12958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:20.878460 12958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:20.879712 12958 hybrid_clock.cc:648] HybridClock initialized: now 1786178060879618 us; error 65 us; skew 500 ppm
I20260808 08:34:20.879936 12958 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:20 dist-test-slave-chsk krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178060, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:20.882264 12958 init.cc:377] Logged in from keytab as oryx/127.5.164.253@KRBTEST.COM (short username oryx)
I20260808 08:34:20.883641 12958 webserver.cc:460] Webserver started at http://127.5.164.253:36735/ using document root <none> and password file <none>
I20260808 08:34:20.884016 12958 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:20.884099 12958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:20.887298 12958 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 08:34:20.895670 13087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:20.896147 12958 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.000s sys 0.008s
I20260808 08:34:20.896301 12958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/wal
uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d"
format_stamp: "Formatted at 2026-08-08 08:34:20 on dist-test-slave-chsk"
server_key: "f81d7c88b9a17423fb94bddbd602368b"
server_key_iv: "6b48e5ce71efb9cc009079beb3ca4ea7"
server_key_version: "encryptionkey@0"
I20260808 08:34:20.896560 12958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:20.912919 12958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:20.917052 12958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:20.945381 12958 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.253:38329
I20260808 08:34:20.945552 13146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.253:38329 every 8 connection(s)
I20260808 08:34:20.946471 12958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-1/data/info.pb
I20260808 08:34:20.952131 13147 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:34:20.957772 13147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: Bootstrap starting.
I20260808 08:34:20.976949 13147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:34:20.977636 13147 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: Bootstrap complete.
I20260808 08:34:20.978760 13147 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: NON_VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: true } }
I20260808 08:34:20.979024 13147 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9c12fe6dcbfe4ab88b0adbaa077dc67d, State: Initialized, Role: LEARNER
I20260808 08:34:20.979281 13147 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: NON_VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: true } }
I20260808 08:34:20.980094 13150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: NON_VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: true } } }
I20260808 08:34:20.980348 13147 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:20.980510 13150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: This master's current role is: LEARNER
I20260808 08:34:20.996964 13161 catalog_manager.cc:1259] Loaded cluster ID: ca305db4b5824c5791d484e4d6419ff4
I20260808 08:34:20.997102 13161 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: loading cluster ID for follower catalog manager: success
I20260808 08:34:20.999732 13161 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: acquiring CA information for follower catalog manager: success
I20260808 08:34:21.001609 13161 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:34:21.062974 12952 heartbeater.cc:503] Master 127.5.164.254:34369 was elected leader, sending a full tablet report...
W20260808 08:34:21.187407 13065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:21.187762 13065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:21.187922 13065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:21.197576 13065 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:21.197835 13065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:21.198016 13065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:21.198271 13065 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:21.198398 13065 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:21.211258 13065 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:34369,127.5.164.253:38329,127.5.164.252:35533
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.252.keytab
--principal=oryx/127.5.164.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.252:35533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.5.164.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:21.212716 13065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:21.214178 13065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:21.231369 13167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:21.231644 13166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:21.231417 13170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:21.232889 13065 server_base.cc:1034] running on GCE node
I20260808 08:34:21.233747 13065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:21.235314 13065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:21.236606 13065 hybrid_clock.cc:648] HybridClock initialized: now 1786178061236484 us; error 53 us; skew 500 ppm
I20260808 08:34:21.237036 13065 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:21 dist-test-slave-chsk krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178061, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:21.241285 13065 init.cc:377] Logged in from keytab as oryx/127.5.164.252@KRBTEST.COM (short username oryx)
I20260808 08:34:21.243083 13065 webserver.cc:460] Webserver started at http://127.5.164.252:36505/ using document root <none> and password file <none>
I20260808 08:34:21.243916 13065 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:21.244092 13065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:21.244385 13065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:21.248391 13065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/data/instance:
uuid: "675f26e913a44d9a895a8e1cf28fd9ce"
format_stamp: "Formatted at 2026-08-08 08:34:21 on dist-test-slave-chsk"
server_key: "9b1836d6a421efdc09cb4372484b1e7d"
server_key_iv: "db0c1dc239db13ca18f1106504ba3d77"
server_key_version: "encryptionkey@0"
I20260808 08:34:21.249292 13065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/wal/instance:
uuid: "675f26e913a44d9a895a8e1cf28fd9ce"
format_stamp: "Formatted at 2026-08-08 08:34:21 on dist-test-slave-chsk"
server_key: "9b1836d6a421efdc09cb4372484b1e7d"
server_key_iv: "db0c1dc239db13ca18f1106504ba3d77"
server_key_version: "encryptionkey@0"
I20260808 08:34:21.255779 13065 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260808 08:34:21.260190 13178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:21.261531 13065 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:34:21.261729 13065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/wal
uuid: "675f26e913a44d9a895a8e1cf28fd9ce"
format_stamp: "Formatted at 2026-08-08 08:34:21 on dist-test-slave-chsk"
server_key: "9b1836d6a421efdc09cb4372484b1e7d"
server_key_iv: "db0c1dc239db13ca18f1106504ba3d77"
server_key_version: "encryptionkey@0"
I20260808 08:34:21.261998 13065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:21.278227 13065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:21.284633 13065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:21.285425 13065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:21.285501 13185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.274521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:38329 (local address 127.0.0.1:52474)
0808 08:34:21.275394 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:21.275419 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:21.275788 (+ 369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:21.276981 (+ 1193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:21.276987 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:21.277030 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:21.277427 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.277444 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.280619 (+ 3175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.280623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.282492 (+ 1869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.282505 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.284578 (+ 2073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.284582 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.284841 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.284910 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 08:34:21.285004 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 08:34:21.285108 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":703,"thread_start_us":576,"threads_started":1}
I20260808 08:34:21.285786 13187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.274772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52474 (local address 127.5.164.253:38329)
0808 08:34:21.276531 (+ 1759us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:21.276537 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:21.276592 (+ 55us) server_negotiation.cc:407] Connection header received
0808 08:34:21.276655 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:21.276658 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:21.276729 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:21.276933 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:21.277640 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.280366 (+ 2726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.282657 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.284404 (+ 1747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.284554 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.284902 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:21.285064 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 08:34:21.285279 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1633,"thread_start_us":1029,"threads_started":1}
I20260808 08:34:21.287072 13120 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260808 08:34:21.288087 13150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6112612728a34903854841302c7d6229. Latest consensus state: current_term: 1 leader_uuid: "6112612728a34903854841302c7d6229" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: NON_VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: true } } }
I20260808 08:34:21.288412 13150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: This master's current role is: LEARNER
I20260808 08:34:21.329026 13065 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.252:35533
I20260808 08:34:21.329257 13237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.252:35533 every 8 connection(s)
I20260808 08:34:21.330801 13065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/data/info.pb
I20260808 08:34:21.337121 13239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:21.340499 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 13065
I20260808 08:34:21.350309 13239 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:34:21 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.164.252@KRBTEST.COM
Aug 08 08:34:21 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178061, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.252@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM
I20260808 08:34:21.374994 13244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.355606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49768 (local address 127.5.164.254:34369)
0808 08:34:21.357019 (+ 1413us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:21.357024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:21.357046 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:34:21.357153 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:21.357158 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:21.357287 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:21.357399 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:21.358968 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.359943 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.361778 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.362761 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.362898 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.367621 (+ 4723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:21.367625 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:21.367629 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:21.367661 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:21.371267 (+ 3606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.372225 (+ 958us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.372231 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.372236 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.372406 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.372830 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.372836 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.372839 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.373211 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:21.373373 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:21.374048 (+ 675us) server_negotiation.cc:299] Negotiation successful
0808 08:34:21.374275 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1210,"thread_start_us":1006,"threads_started":1}
I20260808 08:34:21.376096 13243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.355401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.0.0.1:49768)
0808 08:34:21.356820 (+ 1419us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:21.356861 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:21.357049 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:21.357459 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:21.357464 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:21.358368 (+ 904us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:21.358811 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.358821 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.360149 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.360153 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.361595 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.361613 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.363043 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.363050 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.363295 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.363966 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:21.363987 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:21.367396 (+ 3409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:21.371390 (+ 3994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:21.371400 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:21.371411 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:21.372101 (+ 690us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:21.372522 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:21.372529 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:21.372532 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:21.372702 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:21.373353 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:21.373360 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:21.373632 (+ 272us) client_negotiation.cc:769] Sending connection context
0808 08:34:21.373914 (+ 282us) client_negotiation.cc:240] Negotiation successful
0808 08:34:21.374525 (+ 611us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1156,"thread_start_us":920,"threads_started":1}
I20260808 08:34:21.376132 13242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.343525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57154 (local address 127.5.164.252:35533)
0808 08:34:21.348538 (+ 5013us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:21.348564 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:21.349407 (+ 843us) server_negotiation.cc:407] Connection header received
0808 08:34:21.351782 (+ 2375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:21.351804 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:21.352206 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:21.352516 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:21.355074 (+ 2558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.358207 (+ 3133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.359805 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.360678 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.360880 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.367306 (+ 6426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:21.367319 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:21.367335 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:21.367393 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:21.371390 (+ 3997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.372264 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.372273 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.372276 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.372534 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.372961 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.372965 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.372969 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.373461 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:21.373886 (+ 425us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:21.374213 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 08:34:21.374711 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":126,"server-negotiator.queue_time_us":4673,"thread_start_us":4327,"threads_started":1}
I20260808 08:34:21.377866 13239 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:34:21 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178061, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.252@KRBTEST.COM for oryx/127.5.164.253@KRBTEST.COM
I20260808 08:34:21.393496 13243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.378522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:38329 (local address 127.0.0.1:52486)
0808 08:34:21.378691 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:21.378714 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:21.378794 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:21.379525 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:21.379530 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:21.379924 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:21.380215 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.380224 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.381262 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.381269 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.382341 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.382352 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.383188 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.383194 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.383398 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.384079 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:21.384097 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:21.386944 (+ 2847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:21.390935 (+ 3991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:21.390939 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:21.390942 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:21.391511 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:21.391879 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:21.391883 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:21.391885 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:21.392091 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:21.392650 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:21.392653 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:21.392803 (+ 150us) client_negotiation.cc:769] Sending connection context
0808 08:34:21.392912 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 08:34:21.393210 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 08:34:21.393610 13187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.378912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52486 (local address 127.5.164.253:38329)
0808 08:34:21.379199 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:21.379205 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:21.379225 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:34:21.379285 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:21.379289 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:21.379386 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:21.379501 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:21.380378 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.381133 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.382491 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.383009 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.383147 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.387225 (+ 4078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:21.387232 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:21.387235 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:21.387268 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:21.390805 (+ 3537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.391635 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.391639 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.391641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.391779 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.392185 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.392188 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.392190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.392541 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:21.392663 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:21.393012 (+ 349us) server_negotiation.cc:299] Negotiation successful
0808 08:34:21.393186 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260808 08:34:21.394631 13239 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:34:21 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178061, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.252@KRBTEST.COM for oryx/127.5.164.252@KRBTEST.COM
I20260808 08:34:21.409893 13242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.395683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57158 (local address 127.5.164.252:35533)
0808 08:34:21.395831 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:21.395835 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:21.395850 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:34:21.395888 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:21.395891 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:21.395943 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:21.396020 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:21.396920 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.397859 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.399218 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.399709 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.399863 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.403471 (+ 3608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:21.403477 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:21.403480 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:21.403509 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:21.406684 (+ 3175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.407524 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.407563 (+ 39us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.407565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.407753 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.408273 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.408281 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.408284 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.408574 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:21.408724 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:21.409143 (+ 419us) server_negotiation.cc:299] Negotiation successful
0808 08:34:21.409357 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:34:21.410167 13243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.395391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:35533 (local address 127.0.0.1:57158)
0808 08:34:21.395673 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:21.395692 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:21.395793 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:21.396053 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:21.396075 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:21.396632 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:21.396799 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.396807 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.397988 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.397992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.399027 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.399038 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.399896 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.399900 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.400052 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.400812 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:21.400829 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:21.403276 (+ 2447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:21.406810 (+ 3534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:21.406814 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:21.406816 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:21.407393 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:21.407863 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:21.407867 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:21.407871 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:21.408165 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:21.408687 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:21.408692 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:21.408924 (+ 232us) client_negotiation.cc:769] Sending connection context
0808 08:34:21.409092 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 08:34:21.409474 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":144}
I20260808 08:34:21.415795 13239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: Bootstrap starting.
I20260808 08:34:21.419679 13239 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:21.421427 13239 log.cc:824] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:21.424683 13239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: No bootstrap required, opened a new log
I20260808 08:34:21.435567 13239 raft_consensus.cc:348] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } }
I20260808 08:34:21.436020 13239 raft_consensus.cc:374] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:21.436219 13239 raft_consensus.cc:729] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 675f26e913a44d9a895a8e1cf28fd9ce, State: Initialized, Role: FOLLOWER
I20260808 08:34:21.436944 13239 consensus_queue.cc:260] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } }
I20260808 08:34:21.438369 13246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } } }
I20260808 08:34:21.438789 13246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:21.439524 13239 sys_catalog.cc:564] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [sys.catalog]: configured and running, proceeding with master startup.
W20260808 08:34:21.454162 13259 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:34:21.454440 13259 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:34:21.457614 13065 master_runner.cc:428] Detected that this master 675f26e913a44d9a895a8e1cf28fd9ce is joining an existing cluster
I20260808 08:34:21.457777 13065 master_runner.cc:432] Initiating AddMaster RPC to add 127.5.164.252:35533
I20260808 08:34:21.484331 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 12520
I20260808 08:34:21.497201 13187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.466701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52494 (local address 127.5.164.253:38329)
0808 08:34:21.466922 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:21.466928 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:21.468179 (+ 1251us) server_negotiation.cc:407] Connection header received
0808 08:34:21.468524 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:21.468530 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:21.468619 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:21.468711 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:21.473864 (+ 5153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.475129 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.479583 (+ 4454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.480455 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.480558 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.487805 (+ 7247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:21.487812 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:21.487818 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:21.487862 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:21.492377 (+ 4515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.493361 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.493367 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.493371 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.493627 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.494813 (+ 1186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.494818 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.494822 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.495418 (+ 596us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:21.495590 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:21.496364 (+ 774us) server_negotiation.cc:299] Negotiation successful
0808 08:34:21.496683 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 08:34:21.498322 13244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.464456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49772 (local address 127.5.164.254:34369)
0808 08:34:21.464777 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:21.464783 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:21.466529 (+ 1746us) server_negotiation.cc:407] Connection header received
0808 08:34:21.466835 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:21.466841 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:21.466969 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:21.467057 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:21.470733 (+ 3676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.471802 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.475922 (+ 4120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.476739 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.476860 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.480757 (+ 3897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:21.480767 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:21.480774 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:21.480821 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:21.486268 (+ 5447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.493960 (+ 7692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.493969 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.493973 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.494251 (+ 278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.495170 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.495180 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.495186 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.495693 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:21.495934 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:21.496950 (+ 1016us) server_negotiation.cc:299] Negotiation successful
0808 08:34:21.497884 (+ 934us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145}
I20260808 08:34:21.498847 13266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.466887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:38329 (local address 127.0.0.1:52494)
0808 08:34:21.468068 (+ 1181us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:21.468090 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:21.468325 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:21.469062 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:21.469067 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:21.472332 (+ 3265us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:21.473664 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.473678 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.475392 (+ 1714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.475398 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.479393 (+ 3995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.479412 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.481083 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.481098 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.481387 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.485690 (+ 4303us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:21.485735 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:21.487555 (+ 1820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:21.492583 (+ 5028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:21.492589 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:21.492593 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:21.493211 (+ 618us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:21.493794 (+ 583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:21.493801 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:21.493805 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:21.494619 (+ 814us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:21.495698 (+ 1079us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:21.495706 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:21.496007 (+ 301us) client_negotiation.cc:769] Sending connection context
0808 08:34:21.497523 (+ 1516us) client_negotiation.cc:240] Negotiation successful
0808 08:34:21.497926 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":966,"thread_start_us":667,"threads_started":1}
I20260808 08:34:21.500463 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.464918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.0.0.1:49772)
0808 08:34:21.466410 (+ 1492us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:21.466431 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:21.466665 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:21.467455 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:21.467462 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:21.469105 (+ 1643us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:21.470559 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.470575 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.472229 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.472235 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.475738 (+ 3503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.475775 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.476976 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.476981 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.477241 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.478206 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:21.478233 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:21.480321 (+ 2088us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:21.486442 (+ 6121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:21.486450 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:21.486458 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:21.487257 (+ 799us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:21.494474 (+ 7217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:21.494483 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:21.494490 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:21.494946 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:21.496106 (+ 1160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:21.496112 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:21.496468 (+ 356us) client_negotiation.cc:769] Sending connection context
0808 08:34:21.498755 (+ 2287us) client_negotiation.cc:240] Negotiation successful
0808 08:34:21.499603 (+ 848us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1226,"thread_start_us":824,"threads_started":1}
I20260808 08:34:21.512439 13242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.468426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57166 (local address 127.5.164.252:35533)
0808 08:34:21.468669 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:21.468676 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:21.474283 (+ 5607us) server_negotiation.cc:407] Connection header received
0808 08:34:21.474495 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:21.474499 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:21.474567 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:21.474640 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:21.478346 (+ 3706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.479822 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.484086 (+ 4264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.485370 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.485512 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.502490 (+ 16978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:21.502498 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:21.502505 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:21.502563 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:21.507992 (+ 5429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.509585 (+ 1593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.509593 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.509599 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.509880 (+ 281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.510400 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.510406 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.510409 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.510866 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:21.511037 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:21.511657 (+ 620us) server_negotiation.cc:299] Negotiation successful
0808 08:34:21.511928 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260808 08:34:21.514030 13267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.468761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:35533 (local address 127.0.0.1:57166)
0808 08:34:21.474177 (+ 5416us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:21.474196 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:21.474375 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:21.474795 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:21.474799 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:21.476149 (+ 1350us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:21.478155 (+ 2006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.478175 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.480160 (+ 1985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.480165 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.483837 (+ 3672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.483857 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.493375 (+ 9518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.493384 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.493781 (+ 397us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.495920 (+ 2139us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:21.495948 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:21.499773 (+ 3825us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:21.508702 (+ 8929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:21.508707 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:21.508711 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:21.509393 (+ 682us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:21.510016 (+ 623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:21.510020 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:21.510024 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:21.510271 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:21.511107 (+ 836us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:21.511111 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:21.511322 (+ 211us) client_negotiation.cc:769] Sending connection context
0808 08:34:21.512731 (+ 1409us) client_negotiation.cc:240] Negotiation successful
0808 08:34:21.513213 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5284,"thread_start_us":4183,"threads_started":1}
Aug 08 08:34:21 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.164.193@KRBTEST.COM
Aug 08 08:34:21 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178058, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.254@KRBTEST.COM for oryx/127.5.164.252@KRBTEST.COM
I20260808 08:34:21.530719 13268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.486984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53610 (local address 127.5.164.193:46005)
0808 08:34:21.501042 (+ 14058us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:21.501050 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:21.501078 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:34:21.501149 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:21.501156 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:21.501500 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:21.501728 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:21.504104 (+ 2376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.506108 (+ 2004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.509814 (+ 3706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.510927 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.515492 (+ 4565us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.518678 (+ 3186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:21.518689 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:21.518705 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:21.518739 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:21.525578 (+ 6839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.526914 (+ 1336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.526923 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.526927 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.527238 (+ 311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.528291 (+ 1053us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.528298 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.528301 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.528824 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:21.529255 (+ 431us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:21.529777 (+ 522us) server_negotiation.cc:299] Negotiation successful
0808 08:34:21.530116 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13831,"thread_start_us":15049,"threads_started":1}
I20260808 08:34:21.532765 12656 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:21.533124 13185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.508073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:35533 (local address 127.0.0.1:57176)
0808 08:34:21.508307 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:21.508328 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:21.508427 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:21.510843 (+ 2416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:21.510848 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:21.511513 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:21.511776 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.511790 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.516516 (+ 4726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.516524 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.518400 (+ 1876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.518418 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.519916 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.519925 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.520250 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.520983 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:21.521027 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:21.524508 (+ 3481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:21.529940 (+ 5432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:21.529945 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:21.529949 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:21.530668 (+ 719us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:21.531306 (+ 638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:21.531311 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:21.531314 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:21.531566 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:21.532239 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:21.532247 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:21.532404 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 08:34:21.532526 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 08:34:21.532721 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128}
I20260808 08:34:21.534701 13269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.508887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57176 (local address 127.5.164.252:35533)
0808 08:34:21.510390 (+ 1503us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:21.510396 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:21.510434 (+ 38us) server_negotiation.cc:407] Connection header received
0808 08:34:21.510531 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:21.510537 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:21.510629 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:21.511957 (+ 1328us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:21.512780 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.516341 (+ 3561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.518620 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.519693 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.519873 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.524887 (+ 5014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:21.524898 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:21.524902 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:21.524944 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:21.529779 (+ 4835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.530863 (+ 1084us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.530870 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.530876 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.531132 (+ 256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.531698 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.531703 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.531706 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.532087 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:21.533488 (+ 1401us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:21.533662 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 08:34:21.533937 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1268,"thread_start_us":696,"threads_started":1}
I20260808 08:34:21.536751 12450 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.5.164.252:35533: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce"
member_type: NON_VOTER
last_known_addr {
host: "127.5.164.252"
port: 35533
}
attrs {
promote: true
}
}
dest_uuid: "6112612728a34903854841302c7d6229"
cas_config_opid_index: 5
I20260808 08:34:21.538408 12450 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: NON_VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: true } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: NON_VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: true } }
W20260808 08:34:21.541146 13189 tablet.cc:2369] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:34:21.543277 13246 raft_consensus.cc:482] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:34:21.542907 13184 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 675f26e913a44d9a895a8e1cf28fd9ce (127.5.164.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: NON_VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: true } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: NON_VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: true } } }
I20260808 08:34:21.543730 13246 raft_consensus.cc:504] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } }
I20260808 08:34:21.545781 13246 leader_election.cc:288] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6112612728a34903854841302c7d6229 (127.5.164.254:34369), 9c12fe6dcbfe4ab88b0adbaa077dc67d (127.5.164.253:38329)
I20260808 08:34:21.546881 13120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" is_pre_election: true
I20260808 08:34:21.548306 12460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6112612728a34903854841302c7d6229" is_pre_election: true
I20260808 08:34:21.549510 13182 leader_election.cc:302] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 675f26e913a44d9a895a8e1cf28fd9ce; no voters: 6112612728a34903854841302c7d6229, 9c12fe6dcbfe4ab88b0adbaa077dc67d
I20260808 08:34:21.550470 13246 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 08:34:21.552440 13184 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.5.164.252:35533
I20260808 08:34:21.553149 13065 master.cc:537] Master@127.5.164.252:35533 shutting down...
I20260808 08:34:21.557688 13120 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 1 LEARNER]: Refusing update from remote peer 6112612728a34903854841302c7d6229: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 08:34:21.558609 13272 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: NON_VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 08:34:21.571192 13120 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 675f26e913a44d9a895a8e1cf28fd9ce (127.5.164.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: NON_VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: true } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: NON_VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: true } } }
I20260808 08:34:21.575518 13271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6112612728a34903854841302c7d6229" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: NON_VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: true } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: NON_VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: true } } }
I20260808 08:34:21.575716 13150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6112612728a34903854841302c7d6229" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: NON_VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: true } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: NON_VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: true } } }
I20260808 08:34:21.576059 13150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: This master's current role is: LEARNER
I20260808 08:34:21.576221 13271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:21.576591 13184 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229: attempting to promote NON_VOTER 9c12fe6dcbfe4ab88b0adbaa077dc67d to VOTER
I20260808 08:34:21.577874 13184 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: NON_VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: true } }
I20260808 08:34:21.584004 13120 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 1 LEARNER]: Refusing update from remote peer 6112612728a34903854841302c7d6229: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20260808 08:34:21.585228 12433 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 -> Peer 675f26e913a44d9a895a8e1cf28fd9ce (127.5.164.252:35533): Couldn't send request to peer 675f26e913a44d9a895a8e1cf28fd9ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 08:34:21.585880 13271 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 08:34:21.589920 13271 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 9c12fe6dcbfe4ab88b0adbaa077dc67d (127.5.164.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: NON_VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: true } } }
I20260808 08:34:21.591032 13117 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 9c12fe6dcbfe4ab88b0adbaa077dc67d (127.5.164.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: NON_VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: true } } }
I20260808 08:34:21.593674 13065 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 0 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:21.594081 13065 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 0 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:21.594285 13065 tablet_replica.cc:330] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: stopping tablet replica
I20260808 08:34:21.595343 13150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6112612728a34903854841302c7d6229" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: NON_VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: true } } }
I20260808 08:34:21.595594 13150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:21.596563 13184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6112612728a34903854841302c7d6229" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: NON_VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: true } } }
I20260808 08:34:21.596832 13184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:21.597143 13271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6112612728a34903854841302c7d6229" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: NON_VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: true } } }
I20260808 08:34:21.597364 13271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:21.602361 13065 master.cc:552] Master@127.5.164.252:35533 shutdown complete.
I20260808 08:34:21.602450 13065 master_runner.cc:305] Clearing existing system tablet
I20260808 08:34:21.602849 13065 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:21.602948 13065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:21.607807 13065 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:34:21.609512 13278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:21.609894 13065 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:21.610143 13065 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260808 08:34:21.610249 13065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/wal
uuid: "675f26e913a44d9a895a8e1cf28fd9ce"
format_stamp: "Formatted at 2026-08-08 08:34:21 on dist-test-slave-chsk"
server_key: "9b1836d6a421efdc09cb4372484b1e7d"
server_key_iv: "db0c1dc239db13ca18f1106504ba3d77"
server_key_version: "encryptionkey@0"
I20260808 08:34:21.615190 13065 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:21.622859 13065 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 08:34:21.623116 13065 log.cc:1196] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 08:34:21.624003 13065 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: Deleting consensus metadata
I20260808 08:34:21.624298 13065 master_runner.cc:315] Copying system tablet from 127.5.164.254:34369
I20260808 08:34:21.629078 13065 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: tablet copy: Beginning tablet copy session from remote peer at address 127.5.164.254:34369
I20260808 08:34:21.649163 13284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.629891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.0.0.1:49786)
0808 08:34:21.632078 (+ 2187us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:21.632099 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:21.632297 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:21.632729 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:21.632734 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:21.633630 (+ 896us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:21.633988 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.634002 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.635626 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.635632 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.637422 (+ 1790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:21.637437 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.638537 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.638544 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:21.638791 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.639751 (+ 960us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:21.639775 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:21.641153 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:21.645504 (+ 4351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:21.645510 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:21.645514 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:21.646169 (+ 655us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:21.646663 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:21.646668 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:21.646672 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:21.646933 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:21.647853 (+ 920us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:21.647859 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:21.648107 (+ 248us) client_negotiation.cc:769] Sending connection context
0808 08:34:21.648304 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 08:34:21.648629 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1930,"thread_start_us":1675,"threads_started":1}
I20260808 08:34:21.649433 13244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:21.629962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49786 (local address 127.5.164.254:34369)
0808 08:34:21.630308 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:21.630314 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:21.632224 (+ 1910us) server_negotiation.cc:407] Connection header received
0808 08:34:21.632458 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:21.632464 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:21.632560 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:21.632676 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:21.634164 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.635443 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.637580 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:21.638357 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:21.638507 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:21.641375 (+ 2868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:21.641383 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:21.641397 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:21.641438 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:21.645362 (+ 3924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.646303 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.646309 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.646312 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.646525 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:21.647087 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:21.647093 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:21.647097 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:21.647562 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:21.647762 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:21.648526 (+ 764us) server_negotiation.cc:299] Negotiation successful
0808 08:34:21.648849 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222}
I20260808 08:34:21.650427 12472 tablet_copy_service.cc:140] P 6112612728a34903854841302c7d6229: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 675f26e913a44d9a895a8e1cf28fd9ce ({username='oryx', principal='oryx/127.5.164.252@KRBTEST.COM'} at 127.0.0.1:49786)
I20260808 08:34:21.650657 12472 tablet_copy_service.cc:161] P 6112612728a34903854841302c7d6229: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 675f26e913a44d9a895a8e1cf28fd9ce at {username='oryx', principal='oryx/127.5.164.252@KRBTEST.COM'} at 127.0.0.1:49786: session id = 675f26e913a44d9a895a8e1cf28fd9ce-00000000000000000000000000000000
I20260808 08:34:21.655294 12472 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 08:34:21.657415 13065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 08:34:21.666723 13065 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: tablet copy: Starting download of 0 data blocks...
I20260808 08:34:21.667203 13065 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: tablet copy: Starting download of 1 WAL segments...
I20260808 08:34:21.670511 13065 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 08:34:21.676174 12472 tablet_copy_service.cc:342] P 6112612728a34903854841302c7d6229: Request end of tablet copy session 675f26e913a44d9a895a8e1cf28fd9ce-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.5.164.252@KRBTEST.COM'} at 127.0.0.1:49786
I20260808 08:34:21.676399 12472 tablet_copy_service.cc:433] P 6112612728a34903854841302c7d6229: ending tablet copy session 675f26e913a44d9a895a8e1cf28fd9ce-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 675f26e913a44d9a895a8e1cf28fd9ce
I20260808 08:34:21.688997 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 12520
I20260808 08:34:21.690452 13065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:21.697011 13285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:21.697490 13286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:21.715040 13288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:21.715533 13065 server_base.cc:1034] running on GCE node
I20260808 08:34:21.715929 13065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:21.716730 13065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:21.717947 13065 hybrid_clock.cc:648] HybridClock initialized: now 1786178061717880 us; error 57 us; skew 500 ppm
I20260808 08:34:21.718293 13065 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:21 dist-test-slave-chsk krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178061, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:21.720489 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:46005
--local_ip_for_outbound_sockets=127.5.164.193
--tserver_master_addrs=127.5.164.254:34369
--webserver_port=37067
--webserver_interface=127.5.164.193
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.193.keytab
--principal=oryx/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.5.164.254:34369,127.5.164.253:38329
--tserver_master_addrs=127.5.164.254:34369,127.5.164.253:38329,127.5.164.252:35533 with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:34:21.720970 13065 init.cc:377] Logged in from keytab as oryx/127.5.164.252@KRBTEST.COM (short username oryx)
I20260808 08:34:21.732683 13065 webserver.cc:460] Webserver started at http://127.5.164.252:40697/ using document root <none> and password file <none>
I20260808 08:34:21.733160 13065 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:21.733371 13065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:21.736687 13065 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260808 08:34:21.738942 13296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:21.739464 13065 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260808 08:34:21.739638 13065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/wal
uuid: "675f26e913a44d9a895a8e1cf28fd9ce"
format_stamp: "Formatted at 2026-08-08 08:34:21 on dist-test-slave-chsk"
server_key: "9b1836d6a421efdc09cb4372484b1e7d"
server_key_iv: "db0c1dc239db13ca18f1106504ba3d77"
server_key_version: "encryptionkey@0"
I20260808 08:34:21.739858 13065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:21.785810 13065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:21.789419 13065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:21.828359 13065 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.252:35533
I20260808 08:34:21.828544 13353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.252:35533 every 8 connection(s)
I20260808 08:34:21.829489 13065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/master-2/data/info.pb
I20260808 08:34:21.837986 13354 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:34:21.841683 13354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: Bootstrap starting.
I20260808 08:34:21.860158 13354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:34:21.860849 13354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: Bootstrap complete.
I20260808 08:34:21.862185 13354 raft_consensus.cc:348] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: NON_VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: true } }
I20260808 08:34:21.862604 13354 raft_consensus.cc:729] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 675f26e913a44d9a895a8e1cf28fd9ce, State: Initialized, Role: LEARNER
I20260808 08:34:21.862957 13354 consensus_queue.cc:260] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: NON_VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: true } }
I20260808 08:34:21.864835 13354 sys_catalog.cc:564] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:21.864674 13358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: NON_VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: true } } }
I20260808 08:34:21.865640 13358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [sys.catalog]: This master's current role is: LEARNER
I20260808 08:34:21.883268 13371 catalog_manager.cc:1259] Loaded cluster ID: ca305db4b5824c5791d484e4d6419ff4
I20260808 08:34:21.883399 13371 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: loading cluster ID for follower catalog manager: success
I20260808 08:34:21.886899 13371 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: acquiring CA information for follower catalog manager: success
I20260808 08:34:21.889541 13371 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:34:22.084322 13372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:22.077307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:35533 (local address 127.0.0.1:57178)
0808 08:34:22.077895 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:22.077918 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:22.078097 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:22.078592 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:22.078597 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:22.078627 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:22.078890 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:22.078900 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.080432 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.080438 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:22.081829 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:22.081842 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.083350 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.083356 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:22.083558 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:22.083634 (+ 76us) client_negotiation.cc:769] Sending connection context
0808 08:34:22.083752 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 08:34:22.083927 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":305,"threads_started":1}
I20260808 08:34:22.084391 13373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:22.077491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57178 (local address 127.5.164.252:35533)
0808 08:34:22.078267 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:22.078272 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:22.078291 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:34:22.078353 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:22.078357 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:22.078428 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:22.078560 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:22.079069 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.080285 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.081970 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.083114 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.083293 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:22.083685 (+ 392us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:22.083774 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 08:34:22.083943 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":421,"threads_started":1}
I20260808 08:34:22.085742 13326 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 08:34:22.086483 13358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6112612728a34903854841302c7d6229. Latest consensus state: current_term: 1 leader_uuid: "6112612728a34903854841302c7d6229" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: NON_VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: true } } }
I20260808 08:34:22.086807 13358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [sys.catalog]: This master's current role is: LEARNER
W20260808 08:34:22.177495 13294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:22.177826 13294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:22.178010 13294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:22.185916 13294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:22.186079 13294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:22.186311 13294 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:34:22.196460 13294 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.193.keytab
--principal=oryx/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:46005
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=37067
--tserver_master_addrs=127.5.164.254:34369,127.5.164.253:38329,127.5.164.252:35533
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:22.197953 13294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:22.199381 13294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:22.213004 13382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:22.213023 13380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:22.214387 13378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:22.214545 13294 server_base.cc:1034] running on GCE node
I20260808 08:34:22.215286 13294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:22.216389 13294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:22.217715 13294 hybrid_clock.cc:648] HybridClock initialized: now 1786178062217561 us; error 77 us; skew 500 ppm
I20260808 08:34:22.218181 13294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:22 dist-test-slave-chsk krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178062, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:22.223598 13294 init.cc:377] Logged in from keytab as oryx/127.5.164.193@KRBTEST.COM (short username oryx)
I20260808 08:34:22.226404 13294 webserver.cc:460] Webserver started at http://127.5.164.193:37067/ using document root <none> and password file <none>
I20260808 08:34:22.227352 13294 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:22.227591 13294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:22.235587 13294 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.006s sys 0.000s
I20260808 08:34:22.239651 13391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:22.241426 13294 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:34:22.241626 13294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "71166cb11913487e9305124bfb9c4af5"
format_stamp: "Formatted at 2026-08-08 08:34:18 on dist-test-slave-chsk"
server_key: "5727a5b9156a7e30090de9ac3bedd5ad"
server_key_iv: "22c85071092406a4244d61df520a5d62"
server_key_version: "encryptionkey@0"
I20260808 08:34:22.242822 13294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:22.263370 13294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:22.268590 13294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:22.268949 13294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:22.270502 13294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:22.272691 13294 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:22.272845 13294 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:22.272998 13294 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:22.273123 13294 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:22.363863 13294 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:46005
I20260808 08:34:22.364068 13513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:46005 every 8 connection(s)
I20260808 08:34:22.365698 13294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:34:22.376088 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 13294
I20260808 08:34:22.376551 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 12670
Aug 08 08:34:22 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178062, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.252@KRBTEST.COM
Aug 08 08:34:22 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178062, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.253@KRBTEST.COM
Aug 08 08:34:22 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178062, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM
I20260808 08:34:22.413306 13521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:22.373488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:38329 (local address 127.5.164.193:44687)
0808 08:34:22.376157 (+ 2669us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:22.376179 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:22.376464 (+ 285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:22.385467 (+ 9003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:22.385472 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:22.386591 (+ 1119us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:22.388124 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:22.388139 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.390696 (+ 2557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.390700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:22.393314 (+ 2614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:22.393329 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.395307 (+ 1978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.395320 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:22.395559 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:22.396638 (+ 1079us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:22.396665 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:22.401613 (+ 4948us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:22.407123 (+ 5510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:22.407135 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:22.407223 (+ 88us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:22.408011 (+ 788us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:22.408546 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:22.408551 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:22.408556 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:22.408830 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:22.409730 (+ 900us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:22.409739 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:22.410300 (+ 561us) client_negotiation.cc:769] Sending connection context
0808 08:34:22.410839 (+ 539us) client_negotiation.cc:240] Negotiation successful
0808 08:34:22.411447 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2445,"thread_start_us":2155,"threads_started":1}
I20260808 08:34:22.415211 13522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:22.373690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:44687 (local address 127.5.164.253:38329)
0808 08:34:22.374605 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:22.374610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:22.376676 (+ 2066us) server_negotiation.cc:407] Connection header received
0808 08:34:22.376763 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:22.376769 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:22.376995 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:22.377113 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:22.388350 (+ 11237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.390032 (+ 1682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.393515 (+ 3483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.394523 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.394686 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:22.401971 (+ 7285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:22.401981 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:22.402011 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:22.402071 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:22.406815 (+ 4744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:22.408178 (+ 1363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:22.408184 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:22.408188 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:22.408376 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:22.409038 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:22.409045 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:22.409052 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:22.409481 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:22.409632 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:22.414182 (+ 4550us) server_negotiation.cc:299] Negotiation successful
0808 08:34:22.414464 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":813,"thread_start_us":593,"threads_started":1}
I20260808 08:34:22.415238 13373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:22.372187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:45833 (local address 127.5.164.252:35533)
0808 08:34:22.372399 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:22.372405 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:22.373445 (+ 1040us) server_negotiation.cc:407] Connection header received
0808 08:34:22.376681 (+ 3236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:22.376687 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:22.376780 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:22.376886 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:22.381097 (+ 4211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.382719 (+ 1622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.388851 (+ 6132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.389624 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.389737 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:22.400990 (+ 11253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:22.400998 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:22.401004 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:22.401053 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:22.408152 (+ 7099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:22.411700 (+ 3548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:22.411707 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:22.411710 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:22.411980 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:22.412538 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:22.412543 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:22.412546 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:22.412954 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:22.413194 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:22.414244 (+ 1050us) server_negotiation.cc:299] Negotiation successful
0808 08:34:22.414562 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260808 08:34:22.417270 13520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:22.371915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:35533 (local address 127.5.164.193:45833)
0808 08:34:22.373330 (+ 1415us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:22.373352 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:22.376208 (+ 2856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:22.377387 (+ 1179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:22.377401 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:22.378746 (+ 1345us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:22.380853 (+ 2107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:22.380884 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.382966 (+ 2082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.382975 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:22.388544 (+ 5569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:22.388575 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.390181 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.390191 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:22.390623 (+ 432us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:22.393285 (+ 2662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:22.393318 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:22.400667 (+ 7349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:22.408321 (+ 7654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:22.408326 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:22.408329 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:22.409021 (+ 692us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:22.412150 (+ 3129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:22.412155 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:22.412159 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:22.412379 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:22.413327 (+ 948us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:22.413335 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:22.413844 (+ 509us) client_negotiation.cc:769] Sending connection context
0808 08:34:22.416105 (+ 2261us) client_negotiation.cc:240] Negotiation successful
0808 08:34:22.416475 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1209,"mutex_wait_us":159,"spinlock_wait_cycles":2432,"thread_start_us":929,"threads_started":1}
Aug 08 08:34:22 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.164.194@KRBTEST.COM
I20260808 08:34:22.417465 13516 heartbeater.cc:347] Connected to a master server at 127.5.164.253:38329
I20260808 08:34:22.418880 13516 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:22.419953 13516 heartbeater.cc:511] Master 127.5.164.253:38329 requested a full tablet report, sending...
I20260808 08:34:22.422788 13107 ts_manager.cc:194] Registered new tserver with Master: 71166cb11913487e9305124bfb9c4af5 (127.5.164.193:46005)
I20260808 08:34:22.423395 13514 heartbeater.cc:347] Connected to a master server at 127.5.164.252:35533
I20260808 08:34:22.423563 13514 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:22.424203 13514 heartbeater.cc:511] Master 127.5.164.252:35533 requested a full tablet report, sending...
I20260808 08:34:22.426524 13315 ts_manager.cc:194] Registered new tserver with Master: 71166cb11913487e9305124bfb9c4af5 (127.5.164.193:46005)
I20260808 08:34:22.430927 13524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:22.377512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37204 (local address 127.5.164.194:35373)
0808 08:34:22.392128 (+ 14616us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:22.392137 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:22.398310 (+ 6173us) server_negotiation.cc:407] Connection header received
0808 08:34:22.398747 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:22.398761 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:22.399132 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:22.399421 (+ 289us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:22.403431 (+ 4010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.405738 (+ 2307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.408740 (+ 3002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.410064 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.410207 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:22.420196 (+ 9989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:22.420214 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:22.420231 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:22.420278 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:22.425871 (+ 5593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:22.427271 (+ 1400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:22.427281 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:22.427284 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:22.427624 (+ 340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:22.428198 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:22.428203 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:22.428206 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:22.428808 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:22.429272 (+ 464us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:22.429658 (+ 386us) server_negotiation.cc:299] Negotiation successful
0808 08:34:22.430070 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14304,"thread_start_us":13966,"threads_started":1}
I20260808 08:34:22.431643 13518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:22.369331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:56035 (local address 127.5.164.254:34369)
0808 08:34:22.370393 (+ 1062us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:22.370398 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:22.371670 (+ 1272us) server_negotiation.cc:407] Connection header received
0808 08:34:22.376675 (+ 5005us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:22.376681 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:22.376780 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:22.376942 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:22.381096 (+ 4154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.382931 (+ 1835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.396335 (+ 13404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.397661 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.397826 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:22.418680 (+ 20854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:22.418689 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:22.418694 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:22.418744 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:22.424240 (+ 5496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:22.427498 (+ 3258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:22.427505 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:22.427508 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:22.427749 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:22.428533 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:22.428540 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:22.428545 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:22.428993 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:22.429251 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:22.430751 (+ 1500us) server_negotiation.cc:299] Negotiation successful
0808 08:34:22.431009 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":901,"thread_start_us":797,"threads_started":1}
I20260808 08:34:22.431695 13519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:22.370234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.193:56035)
0808 08:34:22.371459 (+ 1225us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:22.371506 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:22.376208 (+ 4702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:22.377387 (+ 1179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:22.377401 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:22.378728 (+ 1327us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:22.380853 (+ 2125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:22.380884 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.383221 (+ 2337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.383230 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:22.395836 (+ 12606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:22.395854 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:22.398246 (+ 2392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:22.398254 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:22.398567 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:22.400324 (+ 1757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:22.400348 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:22.418373 (+ 18025us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:22.424429 (+ 6056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:22.424437 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:22.424440 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:22.427273 (+ 2833us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:22.427937 (+ 664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:22.427946 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:22.427953 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:22.428376 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:22.430203 (+ 1827us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:22.430212 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:22.430394 (+ 182us) client_negotiation.cc:769] Sending connection context
0808 08:34:22.430571 (+ 177us) client_negotiation.cc:240] Negotiation successful
0808 08:34:22.430902 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":815,"mutex_wait_us":203,"spinlock_wait_cycles":24192,"thread_start_us":517,"threads_started":1}
I20260808 08:34:22.433002 12804 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:22.432994 13515 heartbeater.cc:347] Connected to a master server at 127.5.164.254:34369
I20260808 08:34:22.433243 13515 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:22.434562 13515 heartbeater.cc:511] Master 127.5.164.254:34369 requested a full tablet report, sending...
I20260808 08:34:22.436437 12450 ts_manager.cc:194] Re-registered known tserver with Master: 71166cb11913487e9305124bfb9c4af5 (127.5.164.193:46005)
I20260808 08:34:22.438112 12450 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:56035
I20260808 08:34:22.533093 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 12670
W20260808 08:34:22.552968 12434 connection.cc:535] server connection from 127.5.164.194:42291 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 08:34:22.553786 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:35373
--local_ip_for_outbound_sockets=127.5.164.194
--tserver_master_addrs=127.5.164.254:34369
--webserver_port=41305
--webserver_interface=127.5.164.194
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.194.keytab
--principal=oryx/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.5.164.254:34369,127.5.164.253:38329
--tserver_master_addrs=127.5.164.254:34369,127.5.164.253:38329,127.5.164.252:35533 with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:34:22.641901 13271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6112612728a34903854841302c7d6229" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: NON_VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: true } } }
I20260808 08:34:22.642285 13271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:22.643857 13530 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229: attempting to promote NON_VOTER 675f26e913a44d9a895a8e1cf28fd9ce to VOTER
I20260808 08:34:22.644447 13530 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } }
I20260808 08:34:22.646548 13326 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 1 LEARNER]: Refusing update from remote peer 6112612728a34903854841302c7d6229: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 08:34:22.646754 13117 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 1 FOLLOWER]: Refusing update from remote peer 6112612728a34903854841302c7d6229: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260808 08:34:22.647285 13271 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [LEADER]: Connected to new peer: Peer: permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 08:34:22.647650 13527 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 08:34:22.651098 13530 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 675f26e913a44d9a895a8e1cf28fd9ce (127.5.164.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } } }
I20260808 08:34:22.651917 13117 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 675f26e913a44d9a895a8e1cf28fd9ce (127.5.164.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } } }
I20260808 08:34:22.655937 13271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6112612728a34903854841302c7d6229" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } } }
I20260808 08:34:22.656378 13271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:22.656736 13271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6112612728a34903854841302c7d6229" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } } }
I20260808 08:34:22.657102 13271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:22.658401 13535 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6112612728a34903854841302c7d6229" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } } }
I20260808 08:34:22.659348 13535 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:22.659677 13271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6112612728a34903854841302c7d6229" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } } }
I20260808 08:34:22.659940 13271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:22.661150 13326 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 675f26e913a44d9a895a8e1cf28fd9ce (127.5.164.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } } }
I20260808 08:34:22.667521 13536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6112612728a34903854841302c7d6229" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } } }
I20260808 08:34:22.668025 13536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [sys.catalog]: This master's current role is: FOLLOWER
W20260808 08:34:23.009498 13526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:23.009847 13526 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:23.010022 13526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:23.017675 13526 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:23.017830 13526 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:23.018003 13526 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:34:23.028720 13526 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.194.keytab
--principal=oryx/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:35373
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=41305
--tserver_master_addrs=127.5.164.254:34369,127.5.164.253:38329,127.5.164.252:35533
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:23.030145 13526 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:23.031589 13526 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:23.045439 13541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:23.045410 13542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:23.045480 13544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:23.046800 13526 server_base.cc:1034] running on GCE node
I20260808 08:34:23.047441 13526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:23.048362 13526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:23.049569 13526 hybrid_clock.cc:648] HybridClock initialized: now 1786178063049530 us; error 30 us; skew 500 ppm
I20260808 08:34:23.049837 13526 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:23 dist-test-slave-chsk krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178063, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:23.053014 13526 init.cc:377] Logged in from keytab as oryx/127.5.164.194@KRBTEST.COM (short username oryx)
I20260808 08:34:23.054512 13526 webserver.cc:460] Webserver started at http://127.5.164.194:41305/ using document root <none> and password file <none>
I20260808 08:34:23.055277 13526 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:23.055454 13526 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:23.061055 13526 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:34:23.063879 13551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:23.065205 13526 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:23.065387 13526 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "7e7d7176562845f2a739ccf88f8366ec"
format_stamp: "Formatted at 2026-08-08 08:34:19 on dist-test-slave-chsk"
server_key: "f7029a32fc330d5baea6897c39eb4779"
server_key_iv: "fd1c54dccaf9605d61e33ad70bc4c902"
server_key_version: "encryptionkey@0"
I20260808 08:34:23.066468 13526 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:23.085330 13526 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:23.089534 13526 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:23.089885 13526 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:23.090906 13526 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:23.092320 13526 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:23.092440 13526 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:23.092577 13526 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:23.092669 13526 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:23.128427 13526 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:35373
I20260808 08:34:23.128486 13672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:35373 every 8 connection(s)
I20260808 08:34:23.129969 13526 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:34:23.134296 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 13526
I20260808 08:34:23.134621 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 12817
Aug 08 08:34:23 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178063, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.253@KRBTEST.COM
I20260808 08:34:23.166639 13677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.133041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:33727 (local address 127.5.164.253:38329)
0808 08:34:23.133824 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:23.133832 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:23.134846 (+ 1014us) server_negotiation.cc:407] Connection header received
0808 08:34:23.138564 (+ 3718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:23.138574 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:23.138715 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:23.139020 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:23.142534 (+ 3514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.144185 (+ 1651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.147997 (+ 3812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.148699 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.148825 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.155416 (+ 6591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:23.155427 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:23.155435 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:23.155499 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:23.161826 (+ 6327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.163034 (+ 1208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.163042 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.163045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.163251 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.163915 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.163920 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.163924 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.164338 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:23.164475 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:23.165696 (+ 1221us) server_negotiation.cc:299] Negotiation successful
0808 08:34:23.165946 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":640,"thread_start_us":494,"threads_started":1}
I20260808 08:34:23.169569 13679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.133713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:38329 (local address 127.5.164.194:33727)
0808 08:34:23.134647 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:23.134704 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:23.138090 (+ 3386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:23.139803 (+ 1713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:23.139819 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:23.140956 (+ 1137us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:23.142218 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.142256 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.144513 (+ 2257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.144522 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.147742 (+ 3220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.147768 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.149216 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.149226 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.149655 (+ 429us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.150705 (+ 1050us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:23.150756 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:23.155007 (+ 4251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:23.162079 (+ 7072us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:23.162093 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:23.162111 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:23.162884 (+ 773us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:23.163440 (+ 556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:23.163450 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:23.163453 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:23.163772 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:23.164635 (+ 863us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:23.164647 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:23.165193 (+ 546us) client_negotiation.cc:769] Sending connection context
0808 08:34:23.167192 (+ 1999us) client_negotiation.cc:240] Negotiation successful
0808 08:34:23.167829 (+ 637us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":386,"threads_started":1}
I20260808 08:34:23.171587 13675 heartbeater.cc:347] Connected to a master server at 127.5.164.253:38329
I20260808 08:34:23.171957 13675 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:23.173453 13675 heartbeater.cc:511] Master 127.5.164.253:38329 requested a full tablet report, sending...
Aug 08 08:34:23 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178063, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.252@KRBTEST.COM
I20260808 08:34:23.175472 13107 ts_manager.cc:194] Registered new tserver with Master: 7e7d7176562845f2a739ccf88f8366ec (127.5.164.194:35373)
Aug 08 08:34:23 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178063, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM
I20260808 08:34:23.183706 13682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.135484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:35533 (local address 127.5.164.194:54855)
0808 08:34:23.148124 (+ 12640us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:23.148145 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:23.148366 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:23.164176 (+ 15810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:23.164182 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:23.164850 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:23.165221 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.165236 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.168611 (+ 3375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.168619 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.170721 (+ 2102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.170739 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.172004 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.172076 (+ 72us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.172257 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.172967 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:23.172984 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:23.175697 (+ 2713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:23.180285 (+ 4588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:23.180290 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:23.180296 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:23.180922 (+ 626us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:23.181401 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:23.181409 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:23.181413 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:23.181590 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:23.182407 (+ 817us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:23.182414 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:23.182584 (+ 170us) client_negotiation.cc:769] Sending connection context
0808 08:34:23.182772 (+ 188us) client_negotiation.cc:240] Negotiation successful
0808 08:34:23.183167 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12484,"mutex_wait_us":99,"thread_start_us":12970,"threads_started":1}
Aug 08 08:34:23 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.164.195@KRBTEST.COM
I20260808 08:34:23.184942 13680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.135467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:54855 (local address 127.5.164.252:35533)
0808 08:34:23.163584 (+ 28117us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:23.163591 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:23.163633 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:34:23.163694 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:23.163698 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:23.163781 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:23.166863 (+ 3082us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:23.167052 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.168173 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.170956 (+ 2783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.171789 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.172003 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.175959 (+ 3956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:23.175966 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:23.175972 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:23.176017 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:23.180122 (+ 4105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.181092 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.181098 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.181103 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.181249 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.181720 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.181728 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.181731 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.182175 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:23.182324 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:23.184166 (+ 1842us) server_negotiation.cc:299] Negotiation successful
0808 08:34:23.184427 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27942,"thread_start_us":28495,"threads_started":1}
I20260808 08:34:23.185549 13685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.149115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:35349 (local address 127.5.164.254:34369)
0808 08:34:23.157343 (+ 8228us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:23.157350 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:23.162582 (+ 5232us) server_negotiation.cc:407] Connection header received
0808 08:34:23.162705 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:23.162713 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:23.162818 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:23.162949 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:23.165565 (+ 2616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.166672 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.171322 (+ 4650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.172094 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.172224 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.178879 (+ 6655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:23.178886 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:23.178890 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:23.178954 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:23.182496 (+ 3542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.183250 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.183255 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.183259 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.183397 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.183969 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.183973 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.183975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.184240 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:23.184397 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:23.184863 (+ 466us) server_negotiation.cc:299] Negotiation successful
0808 08:34:23.185149 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8053,"thread_start_us":13070,"threads_started":1}
I20260808 08:34:23.185804 13673 heartbeater.cc:347] Connected to a master server at 127.5.164.252:35533
I20260808 08:34:23.185945 13673 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:23.186460 13686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.150347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.194:35349)
0808 08:34:23.162343 (+ 11996us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:23.162372 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:23.162563 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:23.163006 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:23.163013 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:23.163898 (+ 885us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:23.164375 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.164399 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.168112 (+ 3713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.168121 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.171045 (+ 2924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.171059 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.174480 (+ 3421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.174488 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.174693 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.175763 (+ 1070us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:23.175790 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:23.178646 (+ 2856us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:23.182649 (+ 4003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:23.182653 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:23.182657 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:23.183071 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:23.183518 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:23.183523 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:23.183527 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:23.183681 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:23.184364 (+ 683us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:23.184369 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:23.184523 (+ 154us) client_negotiation.cc:769] Sending connection context
0808 08:34:23.184741 (+ 218us) client_negotiation.cc:240] Negotiation successful
0808 08:34:23.185543 (+ 802us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11804,"mutex_wait_us":4,"thread_start_us":11567,"threads_started":1}
I20260808 08:34:23.186504 13673 heartbeater.cc:511] Master 127.5.164.252:35533 requested a full tablet report, sending...
I20260808 08:34:23.187964 13315 ts_manager.cc:194] Registered new tserver with Master: 7e7d7176562845f2a739ccf88f8366ec (127.5.164.194:35373)
I20260808 08:34:23.188097 13674 heartbeater.cc:347] Connected to a master server at 127.5.164.254:34369
I20260808 08:34:23.188238 13674 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:23.188716 13674 heartbeater.cc:511] Master 127.5.164.254:34369 requested a full tablet report, sending...
I20260808 08:34:23.189770 12450 ts_manager.cc:194] Re-registered known tserver with Master: 7e7d7176562845f2a739ccf88f8366ec (127.5.164.194:35373)
I20260808 08:34:23.190738 12450 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:35349
I20260808 08:34:23.192761 13684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.135854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35668 (local address 127.5.164.195:36121)
0808 08:34:23.161680 (+ 25826us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:23.161695 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:23.170875 (+ 9180us) server_negotiation.cc:407] Connection header received
0808 08:34:23.172458 (+ 1583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:23.172471 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:23.172722 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:23.172864 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:23.175430 (+ 2566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.176713 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.178971 (+ 2258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.179615 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.179770 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.186178 (+ 6408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:23.186198 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:23.186220 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:23.186260 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:23.189780 (+ 3520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.190557 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.190567 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.190571 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.190749 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.191202 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.191208 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.191211 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.191562 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:23.191824 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:23.192176 (+ 352us) server_negotiation.cc:299] Negotiation successful
0808 08:34:23.192379 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25555,"thread_start_us":26460,"threads_started":1}
I20260808 08:34:23.193926 12946 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:23.279759 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 12817
I20260808 08:34:23.301278 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:36121
--local_ip_for_outbound_sockets=127.5.164.195
--tserver_master_addrs=127.5.164.254:34369
--webserver_port=38425
--webserver_interface=127.5.164.195
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.195.keytab
--principal=oryx/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.5.164.254:34369,127.5.164.253:38329
--tserver_master_addrs=127.5.164.254:34369,127.5.164.253:38329,127.5.164.252:35533 with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:34:23.441424 13515 heartbeater.cc:503] Master 127.5.164.254:34369 was elected leader, sending a full tablet report...
W20260808 08:34:23.660739 13688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:23.661034 13688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:23.661132 13688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:23.668802 13688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:23.668921 13688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:23.669154 13688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:34:23.679890 13688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.195.keytab
--principal=oryx/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:36121
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=38425
--tserver_master_addrs=127.5.164.254:34369,127.5.164.253:38329,127.5.164.252:35533
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:23.681355 13688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:23.682773 13688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:23.696676 13694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:23.696779 13695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:23.696806 13697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:23.698035 13688 server_base.cc:1034] running on GCE node
I20260808 08:34:23.698696 13688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:23.699747 13688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:23.700950 13688 hybrid_clock.cc:648] HybridClock initialized: now 1786178063700909 us; error 31 us; skew 500 ppm
I20260808 08:34:23.701285 13688 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:23 dist-test-slave-chsk krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178063, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:23.704627 13688 init.cc:377] Logged in from keytab as oryx/127.5.164.195@KRBTEST.COM (short username oryx)
I20260808 08:34:23.706081 13688 webserver.cc:460] Webserver started at http://127.5.164.195:38425/ using document root <none> and password file <none>
I20260808 08:34:23.706815 13688 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:23.706984 13688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:23.712406 13688 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:34:23.715302 13706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:23.716676 13688 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:23.716861 13688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe"
format_stamp: "Formatted at 2026-08-08 08:34:19 on dist-test-slave-chsk"
server_key: "01eb89c61e5f7e17be42334619a20d31"
server_key_iv: "a99df970f199b9f3e72de833c9b9fae7"
server_key_version: "encryptionkey@0"
I20260808 08:34:23.717921 13688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:23.741291 13688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:23.746733 13688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:23.747051 13688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:23.748087 13688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:23.749573 13688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:23.749706 13688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:23.749837 13688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:23.749917 13688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:23.785764 13688 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:36121
I20260808 08:34:23.785833 13825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:36121 every 8 connection(s)
I20260808 08:34:23.787369 13688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:34:23.789683 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 13688
Aug 08 08:34:23 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178063, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.253@KRBTEST.COM
Aug 08 08:34:23 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178063, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.252@KRBTEST.COM
I20260808 08:34:23.850423 13839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.804077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:35203 (local address 127.5.164.253:38329)
0808 08:34:23.805068 (+ 991us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:23.805078 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:23.814502 (+ 9424us) server_negotiation.cc:407] Connection header received
0808 08:34:23.814618 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:23.814627 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:23.814768 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:23.818494 (+ 3726us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:23.818751 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.820316 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.824204 (+ 3888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.825189 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.826607 (+ 1418us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.831344 (+ 4737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:23.831351 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:23.831355 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:23.831400 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:23.836740 (+ 5340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.843280 (+ 6540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.843287 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.843291 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.843481 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.846302 (+ 2821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.846312 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.846318 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.846813 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:23.849552 (+ 2739us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:23.849705 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 08:34:23.849991 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":845,"thread_start_us":1113,"threads_started":1}
I20260808 08:34:23.851459 13830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.790363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:55305 (local address 127.5.164.252:35533)
0808 08:34:23.799608 (+ 9245us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:23.799614 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:23.802717 (+ 3103us) server_negotiation.cc:407] Connection header received
0808 08:34:23.820729 (+ 18012us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:23.820739 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:23.820858 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:23.821113 (+ 255us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:23.822889 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.824392 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.826684 (+ 2292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.827653 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.827785 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.836007 (+ 8222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:23.836017 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:23.836025 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:23.836084 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:23.842980 (+ 6896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.844897 (+ 1917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.844912 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.844918 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.845182 (+ 264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.845755 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.845763 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.845768 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.847110 (+ 1342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:23.850653 (+ 3543us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:23.850812 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 08:34:23.851080 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9111,"thread_start_us":8983,"threads_started":1}
I20260808 08:34:23.852145 13837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.804012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:38329 (local address 127.5.164.195:35203)
0808 08:34:23.805581 (+ 1569us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:23.805609 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:23.813754 (+ 8145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:23.815369 (+ 1615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:23.815383 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:23.816734 (+ 1351us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:23.818123 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.818163 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.820753 (+ 2590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.820762 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.823897 (+ 3135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.823919 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.825528 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.825539 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.826033 (+ 494us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.827613 (+ 1580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:23.827667 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:23.831059 (+ 3392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:23.837259 (+ 6200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:23.837280 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:23.837306 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:23.838199 (+ 893us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:23.844310 (+ 6111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:23.844318 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:23.844324 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:23.844695 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:23.847529 (+ 2834us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:23.847543 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:23.848232 (+ 689us) client_negotiation.cc:769] Sending connection context
0808 08:34:23.848785 (+ 553us) client_negotiation.cc:240] Negotiation successful
0808 08:34:23.849525 (+ 740us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1386,"thread_start_us":1153,"threads_started":1}
I20260808 08:34:23.852542 13833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.791042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:35533 (local address 127.5.164.195:55305)
0808 08:34:23.802455 (+ 11413us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:23.802522 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:23.820497 (+ 17975us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:23.821411 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:23.821420 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:23.822192 (+ 772us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:23.822636 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.822649 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.824612 (+ 1963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.824617 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.826466 (+ 1849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.826487 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.831317 (+ 4830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.831326 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.831521 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.832206 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:23.832233 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:23.835760 (+ 3527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:23.843368 (+ 7608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:23.843377 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:23.843385 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:23.844130 (+ 745us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:23.845360 (+ 1230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:23.845367 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:23.845373 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:23.845592 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:23.848864 (+ 3272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:23.848872 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:23.849048 (+ 176us) client_negotiation.cc:769] Sending connection context
0808 08:34:23.849202 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 08:34:23.850974 (+ 1772us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10952,"mutex_wait_us":1395,"thread_start_us":11572,"threads_started":1}
I20260808 08:34:23.855769 13826 heartbeater.cc:347] Connected to a master server at 127.5.164.252:35533
I20260808 08:34:23.856416 13826 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:23.857450 13826 heartbeater.cc:511] Master 127.5.164.252:35533 requested a full tablet report, sending...
Aug 08 08:34:23 dist-test-slave-chsk krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178063, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM
I20260808 08:34:23.859263 13828 heartbeater.cc:347] Connected to a master server at 127.5.164.253:38329
I20260808 08:34:23.859422 13828 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:23.859930 13828 heartbeater.cc:511] Master 127.5.164.253:38329 requested a full tablet report, sending...
I20260808 08:34:23.860292 13315 ts_manager.cc:194] Registered new tserver with Master: d4cd6c8e012a4cc4b068ad77bc765cfe (127.5.164.195:36121)
I20260808 08:34:23.861217 13107 ts_manager.cc:194] Registered new tserver with Master: d4cd6c8e012a4cc4b068ad77bc765cfe (127.5.164.195:36121)
I20260808 08:34:23.870713 13840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.805928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:34813 (local address 127.5.164.254:34369)
0808 08:34:23.830090 (+ 24162us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:23.830098 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:23.848907 (+ 18809us) server_negotiation.cc:407] Connection header received
0808 08:34:23.849069 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:23.849074 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:23.849161 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:23.849273 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:23.850368 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.851677 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.854042 (+ 2365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.854733 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.854842 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.862509 (+ 7667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:23.862519 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:23.862524 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:23.862572 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:23.866764 (+ 4192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.867737 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.867743 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.867746 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.867894 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.868401 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.868406 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.868411 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.868791 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:23.868932 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:23.870062 (+ 1130us) server_negotiation.cc:299] Negotiation successful
0808 08:34:23.870298 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23977,"spinlock_wait_cycles":7424,"thread_start_us":8383,"threads_started":1}
I20260808 08:34:23.871433 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.805713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.195:34813)
0808 08:34:23.848767 (+ 43054us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:23.848814 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:23.848939 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:23.849290 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:23.849295 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:23.849954 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:23.850200 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.850210 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.852142 (+ 1932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.852148 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.853877 (+ 1729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.853895 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.855403 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.855410 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.855601 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.856445 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:23.856536 (+ 91us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:23.862317 (+ 5781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:23.866921 (+ 4604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:23.866930 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:23.866936 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:23.867564 (+ 628us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:23.868053 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:23.868059 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:23.868063 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:23.868259 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:23.869021 (+ 762us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:23.869025 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:23.869207 (+ 182us) client_negotiation.cc:769] Sending connection context
0808 08:34:23.869347 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 08:34:23.869696 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42941,"thread_start_us":42770,"threads_started":1}
I20260808 08:34:23.871762 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.804887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49792 (local address 127.5.164.254:34369)
0808 08:34:23.814599 (+ 9712us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:23.814609 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:23.818089 (+ 3480us) server_negotiation.cc:407] Connection header received
0808 08:34:23.818188 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:23.818197 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:23.818308 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:23.818599 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:23.853402 (+ 34803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.854609 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.856739 (+ 2130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.857461 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.857586 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.864402 (+ 6816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:23.864411 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:23.864418 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:23.864469 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:23.868529 (+ 4060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.869387 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.869392 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.869395 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.869524 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.869964 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.869971 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.869974 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.870297 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:23.870523 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:23.871115 (+ 592us) server_negotiation.cc:299] Negotiation successful
0808 08:34:23.871347 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9518,"thread_start_us":25235,"threads_started":1}
I20260808 08:34:23.872335 13827 heartbeater.cc:347] Connected to a master server at 127.5.164.254:34369
I20260808 08:34:23.872494 13827 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:23.873004 13827 heartbeater.cc:511] Master 127.5.164.254:34369 requested a full tablet report, sending...
I20260808 08:34:23.874292 12449 ts_manager.cc:194] Re-registered known tserver with Master: d4cd6c8e012a4cc4b068ad77bc765cfe (127.5.164.195:36121)
I20260808 08:34:23.875561 12449 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:34813
I20260808 08:34:23.876371 13844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.819606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52506 (local address 127.5.164.253:38329)
0808 08:34:23.847799 (+ 28193us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:23.847803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:23.847819 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:34:23.847861 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:23.847865 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:23.847922 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:23.848063 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:23.852815 (+ 4752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.856179 (+ 3364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.860142 (+ 3963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.860868 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.861003 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.865660 (+ 4657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:23.865668 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:23.865673 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:23.865718 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:23.871445 (+ 5727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.873501 (+ 2056us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.873506 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.873509 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.873720 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.874179 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.874184 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.874187 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.874629 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:23.874875 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:23.875539 (+ 664us) server_negotiation.cc:299] Negotiation successful
0808 08:34:23.875799 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28079,"thread_start_us":27890,"threads_started":1}
I20260808 08:34:23.881521 13846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.833189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57188 (local address 127.5.164.252:35533)
0808 08:34:23.845141 (+ 11952us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:23.845148 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:23.855044 (+ 9896us) server_negotiation.cc:407] Connection header received
0808 08:34:23.855108 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:23.855114 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:23.855218 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:23.855328 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:23.858485 (+ 3157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.862429 (+ 3944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.864386 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.865202 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.865338 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.869052 (+ 3714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:23.869060 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:23.869065 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:23.869108 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:23.873294 (+ 4186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.876584 (+ 3290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.876590 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.876594 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.879254 (+ 2660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:23.879714 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:23.879719 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:23.879723 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:23.880116 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:23.880420 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:23.880812 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 08:34:23.881080 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11757,"thread_start_us":11972,"threads_started":1}
I20260808 08:34:23.877403 12449 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49792:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:34:23.886868 12449 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:34:23.931116 13865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.909279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:36121 (local address 127.0.0.1:35680)
0808 08:34:23.923993 (+ 14714us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:23.924016 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:23.924154 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:23.924763 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:23.924768 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:23.924795 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:23.925183 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.925193 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.927018 (+ 1825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.927023 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.928835 (+ 1812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.928848 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.930222 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.930229 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.930418 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.930451 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 08:34:23.930570 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 08:34:23.930701 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14238,"threads_started":1}
I20260808 08:34:23.931109 13864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.909848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35680 (local address 127.5.164.195:36121)
0808 08:34:23.920069 (+ 10221us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:23.920081 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:23.924122 (+ 4041us) server_negotiation.cc:407] Connection header received
0808 08:34:23.924337 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:23.924344 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:23.924567 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:23.924779 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:23.925373 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.926602 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.928994 (+ 2392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.929984 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.930156 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.930384 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:23.930631 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 08:34:23.930786 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9992,"thread_start_us":9777,"threads_started":1}
I20260808 08:34:23.934527 13860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.908928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:46005 (local address 127.0.0.1:53612)
0808 08:34:23.920449 (+ 11521us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:23.920477 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:23.920674 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:23.926193 (+ 5519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:23.926198 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:23.926224 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:23.926593 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.926604 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.928902 (+ 2298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.928911 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.931571 (+ 2660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.931591 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.933954 (+ 2363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.933959 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.934088 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.934113 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:34:23.934174 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 08:34:23.934266 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11354,"thread_start_us":11214,"threads_started":1}
I20260808 08:34:23.934891 13863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.909286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53612 (local address 127.5.164.193:46005)
0808 08:34:23.925534 (+ 16248us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:23.925546 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:23.925578 (+ 32us) server_negotiation.cc:407] Connection header received
0808 08:34:23.925698 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:23.925709 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:23.925952 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:23.926193 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:23.926771 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.928706 (+ 1935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.931846 (+ 3140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.933721 (+ 1875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.933884 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.934164 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:23.934244 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 08:34:23.934459 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16028,"thread_start_us":17095,"threads_started":1}
I20260808 08:34:23.939011 13443 tablet_service.cc:1467] Processing CreateTablet for tablet a034104f56f342488fe1153d29844763 (DEFAULT_TABLE table=test-table [id=7dd9da5a89574098b9ebd36315bfcfa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:23.939635 13755 tablet_service.cc:1467] Processing CreateTablet for tablet a034104f56f342488fe1153d29844763 (DEFAULT_TABLE table=test-table [id=7dd9da5a89574098b9ebd36315bfcfa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:23.940649 13443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a034104f56f342488fe1153d29844763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:23.940986 13755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a034104f56f342488fe1153d29844763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:23.943102 13865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.911365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:35373 (local address 127.0.0.1:37210)
0808 08:34:23.931653 (+ 20288us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:23.931676 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:23.931769 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:23.935916 (+ 4147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:23.935921 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:23.935948 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:23.936178 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.936194 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.938422 (+ 2228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.938427 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.940236 (+ 1809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:23.940253 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.942199 (+ 1946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.942208 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:23.942417 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.942454 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:34:23.942568 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 08:34:23.942709 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20163,"thread_start_us":12015,"threads_started":1}
I20260808 08:34:23.943893 13866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:23.911658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37210 (local address 127.5.164.194:35373)
0808 08:34:23.935351 (+ 23693us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:23.935358 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:23.935382 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:34:23.935511 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:23.935525 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:23.935726 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:23.935930 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:23.936395 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.938257 (+ 1862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.940414 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:23.942011 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:23.942165 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:23.942382 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:23.943370 (+ 988us) server_negotiation.cc:299] Negotiation successful
0808 08:34:23.943605 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23538,"thread_start_us":23362,"threads_started":1}
I20260808 08:34:23.947600 13604 tablet_service.cc:1467] Processing CreateTablet for tablet a034104f56f342488fe1153d29844763 (DEFAULT_TABLE table=test-table [id=7dd9da5a89574098b9ebd36315bfcfa1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:23.949095 13604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a034104f56f342488fe1153d29844763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:23.967965 13868 tablet_bootstrap.cc:492] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe: Bootstrap starting.
I20260808 08:34:23.971850 13869 tablet_bootstrap.cc:492] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5: Bootstrap starting.
I20260808 08:34:23.971927 13868 tablet_bootstrap.cc:654] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:23.973282 13868 log.cc:824] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:23.975484 13869 tablet_bootstrap.cc:654] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:23.976776 13869 log.cc:824] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:23.976882 13868 tablet_bootstrap.cc:492] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe: No bootstrap required, opened a new log
I20260808 08:34:23.977195 13868 ts_tablet_manager.cc:1397] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 08:34:23.978175 13871 tablet_bootstrap.cc:492] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec: Bootstrap starting.
I20260808 08:34:23.980110 13869 tablet_bootstrap.cc:492] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5: No bootstrap required, opened a new log
I20260808 08:34:23.980425 13869 ts_tablet_manager.cc:1397] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260808 08:34:23.981662 13871 tablet_bootstrap.cc:654] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:23.982861 13871 log.cc:824] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:23.987848 13871 tablet_bootstrap.cc:492] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec: No bootstrap required, opened a new log
I20260808 08:34:23.988142 13871 ts_tablet_manager.cc:1397] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260808 08:34:23.988559 13868 raft_consensus.cc:348] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } }
I20260808 08:34:23.989018 13868 raft_consensus.cc:374] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:23.989132 13868 raft_consensus.cc:729] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4cd6c8e012a4cc4b068ad77bc765cfe, State: Initialized, Role: FOLLOWER
I20260808 08:34:23.989264 13869 raft_consensus.cc:348] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } }
I20260808 08:34:23.989744 13869 raft_consensus.cc:374] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:23.989847 13869 raft_consensus.cc:729] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71166cb11913487e9305124bfb9c4af5, State: Initialized, Role: FOLLOWER
I20260808 08:34:23.989830 13868 consensus_queue.cc:260] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } }
I20260808 08:34:23.990427 13869 consensus_queue.cc:260] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } }
I20260808 08:34:23.992473 13869 ts_tablet_manager.cc:1428] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260808 08:34:23.994113 13827 heartbeater.cc:503] Master 127.5.164.254:34369 was elected leader, sending a full tablet report...
I20260808 08:34:23.997817 13868 ts_tablet_manager.cc:1428] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe: Time spent starting tablet: real 0.020s user 0.014s sys 0.004s
I20260808 08:34:24.000648 13871 raft_consensus.cc:348] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } }
I20260808 08:34:24.001231 13871 raft_consensus.cc:374] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:24.001390 13871 raft_consensus.cc:729] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e7d7176562845f2a739ccf88f8366ec, State: Initialized, Role: FOLLOWER
I20260808 08:34:24.002388 13871 consensus_queue.cc:260] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } }
I20260808 08:34:24.007448 13674 heartbeater.cc:503] Master 127.5.164.254:34369 was elected leader, sending a full tablet report...
I20260808 08:34:24.007879 13871 ts_tablet_manager.cc:1428] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec: Time spent starting tablet: real 0.020s user 0.017s sys 0.002s
I20260808 08:34:24.038391 13874 raft_consensus.cc:482] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:34:24.038785 13874 raft_consensus.cc:504] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } }
I20260808 08:34:24.041488 13874 leader_election.cc:288] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71166cb11913487e9305124bfb9c4af5 (127.5.164.193:46005), 7e7d7176562845f2a739ccf88f8366ec (127.5.164.194:35373)
W20260808 08:34:24.046277 13829 tablet.cc:2369] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:34:24.050398 13863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:24.042057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:39773 (local address 127.5.164.193:46005)
0808 08:34:24.042301 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:24.042308 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:24.042672 (+ 364us) server_negotiation.cc:407] Connection header received
0808 08:34:24.042918 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:24.042925 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:24.043005 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:24.043106 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:24.043655 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.044616 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.047860 (+ 3244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.049246 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.049385 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:24.049438 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:24.050036 (+ 598us) server_negotiation.cc:299] Negotiation successful
0808 08:34:24.050132 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 08:34:24.050565 13842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:24.041946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:46005 (local address 127.5.164.195:39773)
0808 08:34:24.042523 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:24.042545 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:24.042719 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:24.043133 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:24.043160 (+ 27us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:24.043186 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:24.043472 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:24.043488 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.044782 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.044787 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:24.047692 (+ 2905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:24.047705 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.049520 (+ 1815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.049528 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:24.049864 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:24.049900 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:34:24.050011 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 08:34:24.050166 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238}
I20260808 08:34:24.051867 13466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a034104f56f342488fe1153d29844763" candidate_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71166cb11913487e9305124bfb9c4af5" is_pre_election: true
I20260808 08:34:24.052187 13833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:24.042599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:35373 (local address 127.5.164.195:49063)
0808 08:34:24.042831 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:24.042851 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:24.042963 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:24.043337 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:24.043341 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:24.043364 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:24.043654 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:24.043675 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.045839 (+ 2164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.045844 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:24.048923 (+ 3079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:24.048941 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.051076 (+ 2135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.051081 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:24.051555 (+ 474us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:24.051580 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:34:24.051716 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 08:34:24.051844 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 08:34:24.052294 13866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:24.042259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:49063 (local address 127.5.164.194:35373)
0808 08:34:24.042435 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:24.042439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:24.042933 (+ 494us) server_negotiation.cc:407] Connection header received
0808 08:34:24.043112 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:24.043117 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:24.043214 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:24.043311 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:24.043831 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.045665 (+ 1834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.049136 (+ 3471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.050884 (+ 1748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.051063 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:24.051195 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:24.051757 (+ 562us) server_negotiation.cc:299] Negotiation successful
0808 08:34:24.051886 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:34:24.052656 13466 raft_consensus.cc:2454] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4cd6c8e012a4cc4b068ad77bc765cfe in term 0.
I20260808 08:34:24.053587 13624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a034104f56f342488fe1153d29844763" candidate_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e7d7176562845f2a739ccf88f8366ec" is_pre_election: true
I20260808 08:34:24.053779 13709 leader_election.cc:302] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71166cb11913487e9305124bfb9c4af5, d4cd6c8e012a4cc4b068ad77bc765cfe; no voters:
I20260808 08:34:24.054183 13624 raft_consensus.cc:2454] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4cd6c8e012a4cc4b068ad77bc765cfe in term 0.
I20260808 08:34:24.054425 13874 raft_consensus.cc:2781] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:34:24.054693 13874 raft_consensus.cc:482] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:34:24.054893 13874 raft_consensus.cc:3037] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:24.058498 13874 raft_consensus.cc:504] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } }
I20260808 08:34:24.059558 13874 leader_election.cc:288] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [CANDIDATE]: Term 1 election: Requested vote from peers 71166cb11913487e9305124bfb9c4af5 (127.5.164.193:46005), 7e7d7176562845f2a739ccf88f8366ec (127.5.164.194:35373)
I20260808 08:34:24.060019 13466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a034104f56f342488fe1153d29844763" candidate_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71166cb11913487e9305124bfb9c4af5"
I20260808 08:34:24.060117 13624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a034104f56f342488fe1153d29844763" candidate_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e7d7176562845f2a739ccf88f8366ec"
I20260808 08:34:24.060292 13466 raft_consensus.cc:3037] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:24.060359 13624 raft_consensus.cc:3037] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:24.064895 13466 raft_consensus.cc:2454] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4cd6c8e012a4cc4b068ad77bc765cfe in term 1.
I20260808 08:34:24.064903 13624 raft_consensus.cc:2454] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4cd6c8e012a4cc4b068ad77bc765cfe in term 1.
I20260808 08:34:24.065430 13710 leader_election.cc:302] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e7d7176562845f2a739ccf88f8366ec, d4cd6c8e012a4cc4b068ad77bc765cfe; no voters:
I20260808 08:34:24.065825 13874 raft_consensus.cc:2781] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:24.066648 13874 raft_consensus.cc:686] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 1 LEADER]: Becoming Leader. State: Replica: d4cd6c8e012a4cc4b068ad77bc765cfe, State: Running, Role: LEADER
I20260808 08:34:24.067369 13874 consensus_queue.cc:237] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } }
I20260808 08:34:24.074281 12449 catalog_manager.cc:5495] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe reported cstate change: term changed from 0 to 1, leader changed from <none> to d4cd6c8e012a4cc4b068ad77bc765cfe (127.5.164.195). New cstate: current_term: 1 leader_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } health_report { overall_health: UNKNOWN } } }
W20260808 08:34:24.121809 13517 tablet.cc:2369] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:34:24.129712 13864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:24.122920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35688 (local address 127.5.164.195:36121)
0808 08:34:24.123125 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:24.123129 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:24.123666 (+ 537us) server_negotiation.cc:407] Connection header received
0808 08:34:24.123912 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:24.123916 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:24.123996 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:24.124176 (+ 180us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:24.124558 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.125526 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.127077 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.127763 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.127904 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:24.128617 (+ 713us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:24.129102 (+ 485us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:24.129259 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:24.129342 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 08:34:24.129423 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260808 08:34:24.134402 13676 tablet.cc:2369] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:34:24.140151 13466 raft_consensus.cc:1261] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5 [term 1 FOLLOWER]: Refusing update from remote peer d4cd6c8e012a4cc4b068ad77bc765cfe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:24.140386 13624 raft_consensus.cc:1261] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec [term 1 FOLLOWER]: Refusing update from remote peer d4cd6c8e012a4cc4b068ad77bc765cfe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:24.141294 13877 consensus_queue.cc:1035] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:24.141887 13874 consensus_queue.cc:1035] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:24.156488 13880 mvcc.cc:205] Tried to move back new op lower bound from 7316185350705410048 to 7316185350425014272. Current Snapshot: MvccSnapshot[applied={T|T < 7316185350705410048}]
I20260808 08:34:24.188333 12449 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49792:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:34:24.188673 12449 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49792:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:34:24.196548 12449 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6112612728a34903854841302c7d6229: Sending DeleteTablet for 3 replicas of tablet a034104f56f342488fe1153d29844763
I20260808 08:34:24.198424 13755 tablet_service.cc:1514] Processing DeleteTablet for tablet a034104f56f342488fe1153d29844763 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:24 UTC) from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:35680
I20260808 08:34:24.199627 13443 tablet_service.cc:1514] Processing DeleteTablet for tablet a034104f56f342488fe1153d29844763 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:24 UTC) from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:53612
I20260808 08:34:24.201401 13891 tablet_replica.cc:330] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5: stopping tablet replica
I20260808 08:34:24.202069 13891 raft_consensus.cc:2229] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:24.202394 13604 tablet_service.cc:1514] Processing DeleteTablet for tablet a034104f56f342488fe1153d29844763 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:24 UTC) from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:37210
I20260808 08:34:24.203110 13890 tablet_replica.cc:330] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe: stopping tablet replica
I20260808 08:34:24.203212 13891 raft_consensus.cc:2258] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:24.203675 13890 raft_consensus.cc:2229] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:34:24.206182 13891 ts_tablet_manager.cc:1905] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:24.208225 13890 raft_consensus.cc:2258] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:24.211457 13890 ts_tablet_manager.cc:1905] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:24.215610 13892 tablet_replica.cc:330] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec: stopping tablet replica
I20260808 08:34:24.216253 13892 raft_consensus.cc:2229] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:24.217099 13892 raft_consensus.cc:2258] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:24.218025 13891 ts_tablet_manager.cc:1918] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:24.218392 13891 log.cc:1196] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/a034104f56f342488fe1153d29844763
I20260808 08:34:24.219515 13891 ts_tablet_manager.cc:1939] T a034104f56f342488fe1153d29844763 P 71166cb11913487e9305124bfb9c4af5: Deleting consensus metadata
I20260808 08:34:24.219755 13892 ts_tablet_manager.cc:1905] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:24.222007 12433 catalog_manager.cc:4841] TS 71166cb11913487e9305124bfb9c4af5 (127.5.164.193:46005): tablet a034104f56f342488fe1153d29844763 (table test-table [id=7dd9da5a89574098b9ebd36315bfcfa1]) successfully deleted
I20260808 08:34:24.227898 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 12414
I20260808 08:34:24.230774 12483 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:24.230854 13892 ts_tablet_manager.cc:1918] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:24.231133 13892 log.cc:1196] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/a034104f56f342488fe1153d29844763
I20260808 08:34:24.232187 13892 ts_tablet_manager.cc:1939] T a034104f56f342488fe1153d29844763 P 7e7d7176562845f2a739ccf88f8366ec: Deleting consensus metadata
I20260808 08:34:24.234604 12434 catalog_manager.cc:4841] TS 7e7d7176562845f2a739ccf88f8366ec (127.5.164.194:35373): tablet a034104f56f342488fe1153d29844763 (table test-table [id=7dd9da5a89574098b9ebd36315bfcfa1]) successfully deleted
I20260808 08:34:24.237198 13890 ts_tablet_manager.cc:1918] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:24.237455 13890 log.cc:1196] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/a034104f56f342488fe1153d29844763
I20260808 08:34:24.238058 13890 ts_tablet_manager.cc:1939] T a034104f56f342488fe1153d29844763 P d4cd6c8e012a4cc4b068ad77bc765cfe: Deleting consensus metadata
I20260808 08:34:24.250104 13844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:24.206562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52518 (local address 127.5.164.253:38329)
0808 08:34:24.206813 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:24.206820 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:24.224689 (+ 17869us) server_negotiation.cc:407] Connection header received
0808 08:34:24.225044 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:24.225051 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:24.225163 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:24.225299 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:24.229917 (+ 4618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.231351 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.236814 (+ 5463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.238105 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.238304 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:24.242573 (+ 4269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:24.242579 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:24.242582 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:24.242624 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:24.246267 (+ 3643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:24.247281 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:24.247292 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:24.247294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:24.247429 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:24.248016 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:24.248020 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:24.248023 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:24.248490 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:24.248875 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:24.249415 (+ 540us) server_negotiation.cc:299] Negotiation successful
0808 08:34:24.249677 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:34:24.268891 13846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:24.226772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57198 (local address 127.5.164.252:35533)
0808 08:34:24.227177 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:24.227195 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:24.250206 (+ 23011us) server_negotiation.cc:407] Connection header received
0808 08:34:24.251099 (+ 893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:24.251104 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:24.251241 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:24.251350 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:24.254009 (+ 2659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.255317 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.257096 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.257743 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.257893 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:24.261361 (+ 3468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:24.261367 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:24.261370 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:24.261407 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:24.265395 (+ 3988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:24.266313 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:24.266322 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:24.266326 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:24.266528 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:24.266997 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:24.267005 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:24.267008 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:24.267395 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:24.267760 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:24.268174 (+ 414us) server_negotiation.cc:299] Negotiation successful
0808 08:34:24.268413 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 08:34:24.422132 12430 catalog_manager.cc:4841] TS d4cd6c8e012a4cc4b068ad77bc765cfe (127.5.164.195:36121): tablet a034104f56f342488fe1153d29844763 (table test-table [id=7dd9da5a89574098b9ebd36315bfcfa1]) successfully deleted
W20260808 08:34:24.422402 12430 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.5.164.195:36121, user_credentials={real_user=slave}} blocked reactor thread for 181913us
I20260808 08:34:24.423691 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 12414
I20260808 08:34:24.479012 13846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:24.460126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57212 (local address 127.5.164.252:35533)
0808 08:34:24.460378 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:24.460386 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:24.460731 (+ 345us) server_negotiation.cc:407] Connection header received
0808 08:34:24.460933 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:24.460940 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:24.461023 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:24.461137 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:24.464359 (+ 3222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.465515 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.467475 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.468101 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.468250 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:24.471659 (+ 3409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:24.471690 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:24.471697 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:24.471741 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:24.475740 (+ 3999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:24.476629 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:24.476634 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:24.476638 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:24.476786 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:24.477221 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:24.477227 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:24.477230 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:24.477647 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:24.477885 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:24.478396 (+ 511us) server_negotiation.cc:299] Negotiation successful
0808 08:34:24.478625 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260808 08:34:24.480111 13844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:24.458792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52528 (local address 127.5.164.253:38329)
0808 08:34:24.459045 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:24.459052 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:24.459074 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:34:24.459521 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:24.459529 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:24.459635 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:24.459738 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:24.462563 (+ 2825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.463762 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.465423 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:24.466294 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:24.466429 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:24.470091 (+ 3662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:24.470100 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:24.470106 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:24.470174 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:24.476136 (+ 5962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:24.476957 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:24.476963 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:24.476968 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:24.477103 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:24.477558 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:24.477563 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:24.477566 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:24.477922 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:24.478191 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:24.479042 (+ 851us) server_negotiation.cc:299] Negotiation successful
0808 08:34:24.479750 (+ 708us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 08:34:25.168045 13901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.167337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.194:48465)
0808 08:34:25.167774 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.167889 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":216,"threads_started":1}
W20260808 08:34:25.168519 13674 heartbeater.cc:644] Failed to heartbeat to 127.5.164.254:34369 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
I20260808 08:34:25.176043 13902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.175301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.195:52391)
0808 08:34:25.175729 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.175838 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":229,"threads_started":1}
W20260808 08:34:25.176468 13827 heartbeater.cc:644] Failed to heartbeat to 127.5.164.254:34369 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
I20260808 08:34:25.181413 13903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.180776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.193:34711)
0808 08:34:25.181169 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.181272 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":229,"threads_started":1}
W20260808 08:34:25.181828 13515 heartbeater.cc:644] Failed to heartbeat to 127.5.164.254:34369 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
I20260808 08:34:25.698355 13904 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6112612728a34903854841302c7d6229)
I20260808 08:34:25.698750 13904 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } }
I20260808 08:34:25.698879 13905 raft_consensus.cc:482] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6112612728a34903854841302c7d6229)
I20260808 08:34:25.699091 13905 raft_consensus.cc:504] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } }
I20260808 08:34:25.700018 13905 leader_election.cc:288] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6112612728a34903854841302c7d6229 (127.5.164.254:34369), 9c12fe6dcbfe4ab88b0adbaa077dc67d (127.5.164.253:38329)
I20260808 08:34:25.700361 13904 leader_election.cc:288] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6112612728a34903854841302c7d6229 (127.5.164.254:34369), 675f26e913a44d9a895a8e1cf28fd9ce (127.5.164.252:35533)
I20260808 08:34:25.701433 13907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.700432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.0.0.1:50254)
0808 08:34:25.700972 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.701141 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":273,"threads_started":1}
I20260808 08:34:25.701454 13906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.700257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.0.0.1:50238)
0808 08:34:25.700946 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.701124 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":432,"threads_started":1}
W20260808 08:34:25.702185 13300 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
W20260808 08:34:25.703083 13090 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
I20260808 08:34:25.705098 13908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.704414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.0.0.1:50278)
0808 08:34:25.704639 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.704866 (+ 227us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 08:34:25.705265 13090 leader_election.cc:334] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6112612728a34903854841302c7d6229 (127.5.164.254:34369): Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
I20260808 08:34:25.705528 13914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.703903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.0.0.1:50270)
0808 08:34:25.705037 (+ 1134us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.705234 (+ 197us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1011,"threads_started":1}
W20260808 08:34:25.705739 13300 leader_election.cc:334] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6112612728a34903854841302c7d6229 (127.5.164.254:34369): Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
I20260808 08:34:25.709439 13906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.701808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:38329 (local address 127.0.0.1:52534)
0808 08:34:25.702774 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.702795 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:25.702931 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:25.703864 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:25.703873 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:25.703910 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:25.704156 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.704169 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.705968 (+ 1799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.705973 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.707325 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.707337 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.708631 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.708642 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.708879 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.708917 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 08:34:25.709025 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 08:34:25.709169 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":849,"mutex_wait_us":21,"spinlock_wait_cycles":896}
I20260808 08:34:25.709522 13909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.701170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52534 (local address 127.5.164.253:38329)
0808 08:34:25.702893 (+ 1723us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.702903 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.702923 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:34:25.703408 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.703415 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.703498 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.703631 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:25.704344 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.705781 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.707462 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.708479 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.708566 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.708628 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.709062 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.709159 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":1588,"thread_start_us":1385,"threads_started":1}
I20260808 08:34:25.710131 13907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.701078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:35533 (local address 127.0.0.1:57218)
0808 08:34:25.701807 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.701844 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:25.702014 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:25.704137 (+ 2123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:25.704141 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:25.704176 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:25.704482 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.704494 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.706429 (+ 1935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.706437 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.707971 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.707984 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.709366 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.709373 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.709583 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.709619 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:34:25.709734 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 08:34:25.709860 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":1752,"threads_started":1}
I20260808 08:34:25.710086 13117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" is_pre_election: true
I20260808 08:34:25.710240 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.701558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57218 (local address 127.5.164.252:35533)
0808 08:34:25.703169 (+ 1611us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.703175 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.703195 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:34:25.703864 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.703870 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.703972 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.704634 (+ 662us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:25.704932 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.706285 (+ 1353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.708108 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.709171 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.709295 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.709393 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.709768 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.709891 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":1429,"spinlock_wait_cycles":5504,"thread_start_us":740,"threads_started":1}
I20260808 08:34:25.710358 13117 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 675f26e913a44d9a895a8e1cf28fd9ce in term 1.
I20260808 08:34:25.710803 13300 leader_election.cc:302] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 675f26e913a44d9a895a8e1cf28fd9ce, 9c12fe6dcbfe4ab88b0adbaa077dc67d; no voters: 6112612728a34903854841302c7d6229
I20260808 08:34:25.710784 13326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" is_pre_election: true
I20260808 08:34:25.711119 13905 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 08:34:25.711285 13905 raft_consensus.cc:482] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6112612728a34903854841302c7d6229)
I20260808 08:34:25.711403 13905 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:34:25.713549 13905 raft_consensus.cc:504] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } }
I20260808 08:34:25.713971 13326 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9c12fe6dcbfe4ab88b0adbaa077dc67d in current term 2: Already voted for candidate 675f26e913a44d9a895a8e1cf28fd9ce in this term.
I20260808 08:34:25.714219 13905 leader_election.cc:288] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [CANDIDATE]: Term 2 election: Requested vote from peers 6112612728a34903854841302c7d6229 (127.5.164.254:34369), 9c12fe6dcbfe4ab88b0adbaa077dc67d (127.5.164.253:38329)
I20260808 08:34:25.714732 13906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.714297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.0.0.1:50292)
0808 08:34:25.714447 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.714529 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 08:34:25.714834 13117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d"
I20260808 08:34:25.715090 13117 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:34:25.715063 13090 leader_election.cc:302] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c12fe6dcbfe4ab88b0adbaa077dc67d; no voters: 6112612728a34903854841302c7d6229, 675f26e913a44d9a895a8e1cf28fd9ce
I20260808 08:34:25.716010 13906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.715387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.0.0.1:50298)
0808 08:34:25.715667 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.715819 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
W20260808 08:34:25.716282 13300 leader_election.cc:334] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6112612728a34903854841302c7d6229 (127.5.164.254:34369): Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
I20260808 08:34:25.718544 13117 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 675f26e913a44d9a895a8e1cf28fd9ce in term 2.
I20260808 08:34:25.718814 13904 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:34:25.719197 13300 leader_election.cc:302] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 675f26e913a44d9a895a8e1cf28fd9ce, 9c12fe6dcbfe4ab88b0adbaa077dc67d; no voters: 6112612728a34903854841302c7d6229
I20260808 08:34:25.719679 13905 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:34:25.720273 13905 raft_consensus.cc:686] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [term 2 LEADER]: Becoming Leader. State: Replica: 675f26e913a44d9a895a8e1cf28fd9ce, State: Running, Role: LEADER
I20260808 08:34:25.720748 13905 consensus_queue.cc:237] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } }
I20260808 08:34:25.723187 13915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader 675f26e913a44d9a895a8e1cf28fd9ce. Latest consensus state: current_term: 2 leader_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } } }
I20260808 08:34:25.723542 13915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:25.726111 13917 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:25.731727 13917 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:25.732895 13917 catalog_manager.cc:1259] Loaded cluster ID: ca305db4b5824c5791d484e4d6419ff4
I20260808 08:34:25.732990 13917 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:25.734403 13917 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:25.735533 13917 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: Loaded TSK: 0
I20260808 08:34:25.736795 13917 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:25.787111 13315 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57212:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:34:25.794548 13315 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:34:25.798971 13906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.798483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.0.0.1:50328)
0808 08:34:25.798695 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.798798 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 08:34:25.799383 13117 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [term 2 FOLLOWER]: Refusing update from remote peer 675f26e913a44d9a895a8e1cf28fd9ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 08:34:25.799998 13906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.799643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.0.0.1:50336)
0808 08:34:25.799787 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.799871 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 08:34:25.800143 13915 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260808 08:34:25.800464 13300 consensus_peers.cc:487] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce -> Peer 6112612728a34903854841302c7d6229 (127.5.164.254:34369): Couldn't send request to peer 6112612728a34903854841302c7d6229. Status: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 08:34:25.802991 13904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 675f26e913a44d9a895a8e1cf28fd9ce. Latest consensus state: current_term: 2 leader_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } } }
I20260808 08:34:25.803352 13904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:25.804860 13915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } } }
I20260808 08:34:25.805152 13915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:25.805572 13904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "6112612728a34903854841302c7d6229" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34369 } } peers { permanent_uuid: "9c12fe6dcbfe4ab88b0adbaa077dc67d" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 38329 } attrs { promote: false } } peers { permanent_uuid: "675f26e913a44d9a895a8e1cf28fd9ce" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 35533 } attrs { promote: false } } }
I20260808 08:34:25.805843 13904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c12fe6dcbfe4ab88b0adbaa077dc67d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:34:25.822260 13925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.813419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53622 (local address 127.5.164.193:46005)
0808 08:34:25.813946 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.813953 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.813971 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:34:25.814047 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.814052 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.814135 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.814248 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:25.814661 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.815858 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.819021 (+ 3163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.820731 (+ 1710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.820905 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.821036 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.821549 (+ 513us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.821771 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":266,"threads_started":1}
I20260808 08:34:25.823252 13906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.813277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:46005 (local address 127.0.0.1:53622)
0808 08:34:25.813451 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.813467 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:25.813552 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:25.814261 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:25.814266 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:25.814290 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:25.814512 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.814521 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.816065 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.816074 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.818719 (+ 2645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.818743 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.820964 (+ 2221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.820974 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.821272 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.821332 (+ 60us) client_negotiation.cc:769] Sending connection context
0808 08:34:25.821445 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 08:34:25.822801 (+ 1356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 08:34:25.824265 13443 tablet_service.cc:1467] Processing CreateTablet for tablet 487833c0693740899f6ddd8fedcd3ef2 (DEFAULT_TABLE table=test-table [id=d80abc7504154dc99d85d2a2671d7e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:25.824801 13443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 487833c0693740899f6ddd8fedcd3ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:25.831758 13914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.814014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:36121 (local address 127.0.0.1:35696)
0808 08:34:25.814194 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.814213 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:25.814330 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:25.824629 (+ 10299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:25.824634 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:25.824667 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:25.825045 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.825057 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.826449 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.826455 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.828697 (+ 2242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.828711 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.830872 (+ 2161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.830877 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.831064 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.831132 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 08:34:25.831243 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 08:34:25.831426 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":44}
I20260808 08:34:25.832213 13928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.815340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37222 (local address 127.5.164.194:35373)
0808 08:34:25.824427 (+ 9087us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.824434 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.824455 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:34:25.824528 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.824533 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.824616 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.824729 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:25.825575 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.826638 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.829217 (+ 2579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.830422 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.830546 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.830676 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.831361 (+ 685us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.831503 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8956,"thread_start_us":8854,"threads_started":1}
I20260808 08:34:25.832927 13927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.814901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35696 (local address 127.5.164.195:36121)
0808 08:34:25.824286 (+ 9385us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:25.824294 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:25.824316 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:34:25.824392 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:25.824396 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:25.824496 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:25.824604 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:25.825210 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.826292 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.828906 (+ 2614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.830542 (+ 1636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.832443 (+ 1901us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.832576 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:25.832619 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 08:34:25.832723 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9222,"thread_start_us":9049,"threads_started":1}
I20260808 08:34:25.833738 13755 tablet_service.cc:1467] Processing CreateTablet for tablet 487833c0693740899f6ddd8fedcd3ef2 (DEFAULT_TABLE table=test-table [id=d80abc7504154dc99d85d2a2671d7e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:25.833884 13926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.814276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:35373 (local address 127.0.0.1:37222)
0808 08:34:25.814939 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.814957 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:25.815069 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:25.824921 (+ 9852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:25.824926 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:25.824953 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:25.825385 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.825397 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.826816 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.826821 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.829033 (+ 2212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:25.829047 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:25.830858 (+ 1811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:25.830865 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:25.831058 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:25.831175 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 08:34:25.831242 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 08:34:25.833489 (+ 2247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"mutex_wait_us":2116,"thread_start_us":1154,"threads_started":1}
I20260808 08:34:25.834235 13755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 487833c0693740899f6ddd8fedcd3ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:25.840169 13930 tablet_bootstrap.cc:492] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe: Bootstrap starting.
I20260808 08:34:25.840057 13604 tablet_service.cc:1467] Processing CreateTablet for tablet 487833c0693740899f6ddd8fedcd3ef2 (DEFAULT_TABLE table=test-table [id=d80abc7504154dc99d85d2a2671d7e34]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:25.840737 13604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 487833c0693740899f6ddd8fedcd3ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:25.842283 13930 tablet_bootstrap.cc:654] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:25.844758 13930 tablet_bootstrap.cc:492] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe: No bootstrap required, opened a new log
I20260808 08:34:25.844964 13930 ts_tablet_manager.cc:1397] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260808 08:34:25.845880 13930 raft_consensus.cc:348] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } }
I20260808 08:34:25.846240 13930 raft_consensus.cc:374] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:25.846369 13930 raft_consensus.cc:729] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4cd6c8e012a4cc4b068ad77bc765cfe, State: Initialized, Role: FOLLOWER
I20260808 08:34:25.846680 13930 consensus_queue.cc:260] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } }
I20260808 08:34:25.853505 13934 tablet_bootstrap.cc:492] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec: Bootstrap starting.
I20260808 08:34:25.855849 13929 tablet_bootstrap.cc:492] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5: Bootstrap starting.
I20260808 08:34:25.856607 13934 tablet_bootstrap.cc:654] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:25.858136 13930 ts_tablet_manager.cc:1428] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe: Time spent starting tablet: real 0.013s user 0.003s sys 0.009s
I20260808 08:34:25.859772 13937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.858451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.195:34935)
0808 08:34:25.859246 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.859467 (+ 221us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":365,"threads_started":1}
I20260808 08:34:25.862156 13934 tablet_bootstrap.cc:492] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec: No bootstrap required, opened a new log
I20260808 08:34:25.862362 13934 ts_tablet_manager.cc:1397] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260808 08:34:25.863529 13934 raft_consensus.cc:348] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } }
I20260808 08:34:25.863862 13934 raft_consensus.cc:374] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:25.863986 13934 raft_consensus.cc:729] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e7d7176562845f2a739ccf88f8366ec, State: Initialized, Role: FOLLOWER
I20260808 08:34:25.864353 13934 consensus_queue.cc:260] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } }
I20260808 08:34:25.865909 13938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.860536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.195:40717)
0808 08:34:25.865370 (+ 4834us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.865567 (+ 197us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4683,"thread_start_us":4539,"threads_started":1}
I20260808 08:34:25.866175 13826 heartbeater.cc:503] Master 127.5.164.252:35533 was elected leader, sending a full tablet report...
I20260808 08:34:25.866449 13934 ts_tablet_manager.cc:1428] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260808 08:34:25.870402 13929 tablet_bootstrap.cc:654] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:25.870817 13941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.865679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.194:37305)
0808 08:34:25.869620 (+ 3941us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.869800 (+ 180us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3754,"thread_start_us":3611,"threads_started":1}
I20260808 08:34:25.871594 13673 heartbeater.cc:503] Master 127.5.164.252:35533 was elected leader, sending a full tablet report...
I20260808 08:34:25.872545 13941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.871757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.194:46817)
0808 08:34:25.872308 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.872405 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429}
I20260808 08:34:25.876071 13929 tablet_bootstrap.cc:492] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5: No bootstrap required, opened a new log
I20260808 08:34:25.876277 13929 ts_tablet_manager.cc:1397] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.007s
I20260808 08:34:25.876968 13929 raft_consensus.cc:348] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } }
I20260808 08:34:25.877187 13929 raft_consensus.cc:374] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:25.877310 13929 raft_consensus.cc:729] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71166cb11913487e9305124bfb9c4af5, State: Initialized, Role: FOLLOWER
I20260808 08:34:25.877579 13929 consensus_queue.cc:260] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } }
I20260808 08:34:25.878386 13929 ts_tablet_manager.cc:1428] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 08:34:25.879703 13944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.878681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.193:53503)
0808 08:34:25.879266 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.879442 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":265,"threads_started":1}
I20260808 08:34:25.880749 13944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.880355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.193:53157)
0808 08:34:25.880504 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.880579 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 08:34:25.880942 13514 heartbeater.cc:503] Master 127.5.164.252:35533 was elected leader, sending a full tablet report...
I20260808 08:34:25.983451 13933 raft_consensus.cc:482] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:34:25.983738 13933 raft_consensus.cc:504] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } }
I20260808 08:34:25.984648 13933 leader_election.cc:288] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71166cb11913487e9305124bfb9c4af5 (127.5.164.193:46005), 7e7d7176562845f2a739ccf88f8366ec (127.5.164.194:35373)
I20260808 08:34:25.985365 13466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "487833c0693740899f6ddd8fedcd3ef2" candidate_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71166cb11913487e9305124bfb9c4af5" is_pre_election: true
I20260808 08:34:25.985363 13624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "487833c0693740899f6ddd8fedcd3ef2" candidate_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e7d7176562845f2a739ccf88f8366ec" is_pre_election: true
I20260808 08:34:25.985672 13624 raft_consensus.cc:2454] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4cd6c8e012a4cc4b068ad77bc765cfe in term 0.
I20260808 08:34:25.985672 13466 raft_consensus.cc:2454] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4cd6c8e012a4cc4b068ad77bc765cfe in term 0.
I20260808 08:34:25.986217 13709 leader_election.cc:302] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71166cb11913487e9305124bfb9c4af5, d4cd6c8e012a4cc4b068ad77bc765cfe; no voters:
I20260808 08:34:25.986562 13933 raft_consensus.cc:2781] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:34:25.986711 13933 raft_consensus.cc:482] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:34:25.986845 13933 raft_consensus.cc:3037] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:25.989398 13933 raft_consensus.cc:504] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } }
I20260808 08:34:25.990101 13933 leader_election.cc:288] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [CANDIDATE]: Term 1 election: Requested vote from peers 71166cb11913487e9305124bfb9c4af5 (127.5.164.193:46005), 7e7d7176562845f2a739ccf88f8366ec (127.5.164.194:35373)
I20260808 08:34:25.990752 13466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "487833c0693740899f6ddd8fedcd3ef2" candidate_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71166cb11913487e9305124bfb9c4af5"
I20260808 08:34:25.990845 13624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "487833c0693740899f6ddd8fedcd3ef2" candidate_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e7d7176562845f2a739ccf88f8366ec"
I20260808 08:34:25.990979 13466 raft_consensus.cc:3037] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:25.991209 13624 raft_consensus.cc:3037] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:25.993399 13624 raft_consensus.cc:2454] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4cd6c8e012a4cc4b068ad77bc765cfe in term 1.
I20260808 08:34:25.993440 13466 raft_consensus.cc:2454] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4cd6c8e012a4cc4b068ad77bc765cfe in term 1.
I20260808 08:34:25.993974 13709 leader_election.cc:302] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71166cb11913487e9305124bfb9c4af5, d4cd6c8e012a4cc4b068ad77bc765cfe; no voters:
I20260808 08:34:25.994349 13933 raft_consensus.cc:2781] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:25.994815 13933 raft_consensus.cc:686] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 1 LEADER]: Becoming Leader. State: Replica: d4cd6c8e012a4cc4b068ad77bc765cfe, State: Running, Role: LEADER
I20260808 08:34:25.995227 13933 consensus_queue.cc:237] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } }
I20260808 08:34:25.996001 13937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:25.995558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.195:34289)
0808 08:34:25.995728 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:25.995849 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 08:34:25.998411 13315 catalog_manager.cc:5495] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe reported cstate change: term changed from 0 to 1, leader changed from <none> to d4cd6c8e012a4cc4b068ad77bc765cfe (127.5.164.195). New cstate: current_term: 1 leader_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4cd6c8e012a4cc4b068ad77bc765cfe" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36121 } health_report { overall_health: HEALTHY } } }
I20260808 08:34:26.026350 13927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.021290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35702 (local address 127.5.164.195:36121)
0808 08:34:26.021488 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:26.021492 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:26.021631 (+ 139us) server_negotiation.cc:407] Connection header received
0808 08:34:26.021853 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:26.021859 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:26.021940 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:26.022053 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:26.022463 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.023283 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.024563 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.025015 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.025169 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:26.025576 (+ 407us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:26.025707 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:26.025809 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:26.025968 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 08:34:26.026066 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:34:26.030035 13466 raft_consensus.cc:1261] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5 [term 1 FOLLOWER]: Refusing update from remote peer d4cd6c8e012a4cc4b068ad77bc765cfe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:26.030028 13624 raft_consensus.cc:1261] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec [term 1 FOLLOWER]: Refusing update from remote peer d4cd6c8e012a4cc4b068ad77bc765cfe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:26.030821 13945 consensus_queue.cc:1035] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e7d7176562845f2a739ccf88f8366ec" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:26.031226 13933 consensus_queue.cc:1035] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "71166cb11913487e9305124bfb9c4af5" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 46005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:26.034878 13944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.033944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.193:33745)
0808 08:34:26.034583 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:26.034708 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":517}
I20260808 08:34:26.035562 13941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.034330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.194:60399)
0808 08:34:26.035323 (+ 993us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:26.035414 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":889}
I20260808 08:34:26.044520 13944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.043947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.193:48171)
0808 08:34:26.044215 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:26.044329 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142}
I20260808 08:34:26.044548 13937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.043775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.195:37621)
0808 08:34:26.044215 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:26.044342 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":314}
I20260808 08:34:26.052609 13941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.051922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.194:57803)
0808 08:34:26.052246 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:26.052370 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
I20260808 08:34:26.052969 13937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.052415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.5.164.195:43009)
0808 08:34:26.052700 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:26.052798 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165}
I20260808 08:34:26.056360 13315 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:34:26.056726 13315 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57212:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:34:26.062747 13315 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 675f26e913a44d9a895a8e1cf28fd9ce: Sending DeleteTablet for 3 replicas of tablet 487833c0693740899f6ddd8fedcd3ef2
I20260808 08:34:26.063764 13443 tablet_service.cc:1514] Processing DeleteTablet for tablet 487833c0693740899f6ddd8fedcd3ef2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:26 UTC) from {username='oryx', principal='oryx/127.5.164.252@KRBTEST.COM'} at 127.0.0.1:53622
I20260808 08:34:26.063911 13604 tablet_service.cc:1514] Processing DeleteTablet for tablet 487833c0693740899f6ddd8fedcd3ef2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:26 UTC) from {username='oryx', principal='oryx/127.5.164.252@KRBTEST.COM'} at 127.0.0.1:37222
I20260808 08:34:26.063971 13755 tablet_service.cc:1514] Processing DeleteTablet for tablet 487833c0693740899f6ddd8fedcd3ef2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:26 UTC) from {username='oryx', principal='oryx/127.5.164.252@KRBTEST.COM'} at 127.0.0.1:35696
I20260808 08:34:26.064011 13603 tablet_service.cc:1514] Processing DeleteTablet for tablet 487833c0693740899f6ddd8fedcd3ef2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:26 UTC) from {username='oryx', principal='oryx/127.5.164.252@KRBTEST.COM'} at 127.0.0.1:37222
I20260808 08:34:26.065850 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 13294
I20260808 08:34:26.072710 13960 tablet_replica.cc:330] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec: stopping tablet replica
I20260808 08:34:26.073432 13959 tablet_replica.cc:330] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5: stopping tablet replica
I20260808 08:34:26.073845 13959 raft_consensus.cc:2229] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:26.074270 13960 raft_consensus.cc:2229] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:26.074721 13960 raft_consensus.cc:2258] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:26.075311 13959 raft_consensus.cc:2258] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:26.076022 13961 tablet_replica.cc:330] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe: stopping tablet replica
I20260808 08:34:26.076251 13961 raft_consensus.cc:2229] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:34:26.076690 13961 raft_consensus.cc:2258] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:26.076784 13959 ts_tablet_manager.cc:1905] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:26.077638 13961 ts_tablet_manager.cc:1905] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:26.079821 13960 ts_tablet_manager.cc:1905] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:26.083998 13959 ts_tablet_manager.cc:1918] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:26.084211 13959 log.cc:1196] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/487833c0693740899f6ddd8fedcd3ef2
I20260808 08:34:26.084372 13961 ts_tablet_manager.cc:1918] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:26.084520 13961 log.cc:1196] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/487833c0693740899f6ddd8fedcd3ef2
I20260808 08:34:26.084674 13959 ts_tablet_manager.cc:1939] T 487833c0693740899f6ddd8fedcd3ef2 P 71166cb11913487e9305124bfb9c4af5: Deleting consensus metadata
I20260808 08:34:26.085160 13961 ts_tablet_manager.cc:1939] T 487833c0693740899f6ddd8fedcd3ef2 P d4cd6c8e012a4cc4b068ad77bc765cfe: Deleting consensus metadata
I20260808 08:34:26.086000 13300 catalog_manager.cc:4841] TS 71166cb11913487e9305124bfb9c4af5 (127.5.164.193:46005): tablet 487833c0693740899f6ddd8fedcd3ef2 (table test-table [id=d80abc7504154dc99d85d2a2671d7e34]) successfully deleted
I20260808 08:34:26.086474 13297 catalog_manager.cc:4841] TS d4cd6c8e012a4cc4b068ad77bc765cfe (127.5.164.195:36121): tablet 487833c0693740899f6ddd8fedcd3ef2 (table test-table [id=d80abc7504154dc99d85d2a2671d7e34]) successfully deleted
I20260808 08:34:26.087440 13960 ts_tablet_manager.cc:1918] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:26.087589 13960 log.cc:1196] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/487833c0693740899f6ddd8fedcd3ef2
I20260808 08:34:26.088008 13960 ts_tablet_manager.cc:1939] T 487833c0693740899f6ddd8fedcd3ef2 P 7e7d7176562845f2a739ccf88f8366ec: Deleting consensus metadata
I20260808 08:34:26.089141 13301 catalog_manager.cc:4841] TS 7e7d7176562845f2a739ccf88f8366ec (127.5.164.194:35373): tablet 487833c0693740899f6ddd8fedcd3ef2 (table test-table [id=d80abc7504154dc99d85d2a2671d7e34]) successfully deleted
W20260808 08:34:26.089723 13301 catalog_manager.cc:4808] TS 7e7d7176562845f2a739ccf88f8366ec (127.5.164.194:35373): delete failed for tablet 487833c0693740899f6ddd8fedcd3ef2 because the tablet was not found. No further retry: Not found: Tablet not found: 487833c0693740899f6ddd8fedcd3ef2
I20260808 08:34:26.090126 13925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.067165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53636 (local address 127.5.164.193:46005)
0808 08:34:26.067455 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:26.067464 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:26.071879 (+ 4415us) server_negotiation.cc:407] Connection header received
0808 08:34:26.072150 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:26.072160 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:26.072282 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:26.072426 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:26.074290 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.075405 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.077324 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.077992 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.078095 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:26.082298 (+ 4203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:26.082321 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:26.082347 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:26.082403 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:26.086761 (+ 4358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:26.087819 (+ 1058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:26.087827 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:26.087829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:26.087969 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:26.088445 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:26.088450 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:26.088452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:26.088844 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:26.089163 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:26.089542 (+ 379us) server_negotiation.cc:299] Negotiation successful
0808 08:34:26.089805 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 08:34:26.091537 13508 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:26.195483 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 13294
I20260808 08:34:26.217399 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 13526
I20260808 08:34:26.232250 13928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.218326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37236 (local address 127.5.164.194:35373)
0808 08:34:26.218644 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:26.218650 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:26.218685 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:34:26.218824 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:26.218828 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:26.218904 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:26.218990 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:26.220393 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.221112 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.222535 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.222943 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.223040 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:26.225717 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:26.225735 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:26.225752 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:26.225789 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:26.228978 (+ 3189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:26.229812 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:26.229820 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:26.229823 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:26.229957 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:26.230456 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:26.230459 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:26.230461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:26.230868 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:26.231090 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:26.231682 (+ 592us) server_negotiation.cc:299] Negotiation successful
0808 08:34:26.231868 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260808 08:34:26.233000 13668 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:26.276157 13926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.275705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.0.0.1:50340)
0808 08:34:26.275911 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:26.275999 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 08:34:26.277226 13926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.276856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:34369 (local address 127.0.0.1:50354)
0808 08:34:26.277012 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:26.277098 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 08:34:26.328358 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 13526
I20260808 08:34:26.351985 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 13688
I20260808 08:34:26.365343 13927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.352836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35718 (local address 127.5.164.195:36121)
0808 08:34:26.353033 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:26.353038 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:26.353058 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:34:26.353174 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:26.353178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:26.353273 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:26.353360 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:26.354723 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.355565 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.356718 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:26.357114 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:26.357205 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:26.359790 (+ 2585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:26.359806 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:26.359822 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:26.359858 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:26.362794 (+ 2936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:26.363450 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:26.363457 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:26.363459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:26.363583 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:26.363903 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:26.363907 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:26.363909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:26.364277 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:26.364501 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:26.364736 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 08:34:26.364973 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 08:34:26.366080 13821 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:26.490417 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 13688
I20260808 08:34:26.518898 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 12958
I20260808 08:34:26.520208 13142 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:26.640298 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 12958
I20260808 08:34:26.664263 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 13065
I20260808 08:34:26.665333 13926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.664762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:38329 (local address 127.0.0.1:52544)
0808 08:34:26.664986 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:26.665133 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:38329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 08:34:26.665475 13349 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:26.790587 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 13065
I20260808 08:34:26.790702 13926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:26.666135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:38329 (local address 127.0.0.1:52558)
0808 08:34:26.790311 (+124176us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:26.790467 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:38329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
2026-08-08T08:34:26Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10322 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:26 dist-test-slave-chsk krb5kdc[13971](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:26 dist-test-slave-chsk krb5kdc[13971](info): set up 2 sockets
Aug 08 08:34:26 dist-test-slave-chsk krb5kdc[13971](info): commencing operation
krb5kdc: starting...
W20260808 08:34:27.962402 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.005s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:34:28 dist-test-slave-chsk krb5kdc[13971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:28Z Disabled control of system clock
WARNING: no policy specified for oryx/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.254.keytab.
Entry for principal oryx/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.254.keytab.
I20260808 08:34:28.231688 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:39653
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.254.keytab
--principal=oryx/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:36029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:39653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:28.581240 13987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:28.581552 13987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:28.581648 13987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:28.589749 13987 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:28.589882 13987 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 08:34:28.589931 13987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:28.590003 13987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:28.590054 13987 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:28.590126 13987 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:28.600647 13987 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:36029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:39653
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.254.keytab
--principal=oryx/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:39653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:28.601953 13987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:28.603322 13987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:28.615360 13992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:28.615391 13994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:28.615314 13996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:28.617022 13987 server_base.cc:1034] running on GCE node
I20260808 08:34:28.617949 13987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:28.619542 13987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:28.620807 13987 hybrid_clock.cc:648] HybridClock initialized: now 1786178068620750 us; error 34 us; skew 500 ppm
I20260808 08:34:28.621160 13987 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:28 dist-test-slave-chsk krb5kdc[13971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:28.624439 13987 init.cc:377] Logged in from keytab as oryx/127.5.164.254@KRBTEST.COM (short username oryx)
I20260808 08:34:28.625975 13987 webserver.cc:460] Webserver started at http://127.5.164.254:33795/ using document root <none> and password file <none>
I20260808 08:34:28.626737 13987 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:28.626876 13987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:28.627285 13987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:28.630437 13987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "96f6fe5fc1ef4642be9ea15146a21b92"
format_stamp: "Formatted at 2026-08-08 08:34:28 on dist-test-slave-chsk"
server_key: "61832ca632caf01c64f52af69f6d0bba"
server_key_iv: "ce3f0079a582eaa7173a94c0dfdd4cc5"
server_key_version: "encryptionkey@0"
I20260808 08:34:28.631377 13987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "96f6fe5fc1ef4642be9ea15146a21b92"
format_stamp: "Formatted at 2026-08-08 08:34:28 on dist-test-slave-chsk"
server_key: "61832ca632caf01c64f52af69f6d0bba"
server_key_iv: "ce3f0079a582eaa7173a94c0dfdd4cc5"
server_key_version: "encryptionkey@0"
I20260808 08:34:28.636932 13987 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:34:28.640733 14004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:28.642359 13987 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:34:28.642567 13987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "96f6fe5fc1ef4642be9ea15146a21b92"
format_stamp: "Formatted at 2026-08-08 08:34:28 on dist-test-slave-chsk"
server_key: "61832ca632caf01c64f52af69f6d0bba"
server_key_iv: "ce3f0079a582eaa7173a94c0dfdd4cc5"
server_key_version: "encryptionkey@0"
I20260808 08:34:28.642822 13987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:28.655445 13987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:28.659585 13987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:28.659880 13987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:28.681366 13987 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:39653
I20260808 08:34:28.681406 14073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:39653 every 8 connection(s)
I20260808 08:34:28.682821 13987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:28.686744 14074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:28.689988 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 13987
I20260808 08:34:28.690238 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:34:28.690912 5779 external_mini_cluster.cc:1428] Setting key 4ba9068c18e0da364edf00dcb5472190
I20260808 08:34:28.699937 14074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92: Bootstrap starting.
I20260808 08:34:28.703964 14074 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:28.705384 14074 log.cc:824] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:34:28 dist-test-slave-chsk krb5kdc[13971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM
I20260808 08:34:28.708547 14074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92: No bootstrap required, opened a new log
I20260808 08:34:28.714864 14077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:28.693098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40304 (local address 127.5.164.254:39653)
0808 08:34:28.693900 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:28.693911 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:28.693954 (+ 43us) server_negotiation.cc:407] Connection header received
0808 08:34:28.695726 (+ 1772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:28.695749 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:28.696174 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:28.696520 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:28.698329 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.699671 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.701447 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:28.702193 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:28.702330 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:28.707349 (+ 5019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:28.707357 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:28.707371 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:28.707411 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:28.710613 (+ 3202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.711346 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.711353 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.711358 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.711530 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:28.711939 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:28.711945 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:28.711956 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:28.712508 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:28.712872 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:28.713389 (+ 517us) server_negotiation.cc:299] Negotiation successful
0808 08:34:28.713809 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":382,"threads_started":1}
I20260808 08:34:28.716971 14074 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96f6fe5fc1ef4642be9ea15146a21b92" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39653 } }
I20260808 08:34:28.717357 14074 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:28.717489 14074 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96f6fe5fc1ef4642be9ea15146a21b92, State: Initialized, Role: FOLLOWER
I20260808 08:34:28.718091 14074 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96f6fe5fc1ef4642be9ea15146a21b92" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39653 } }
I20260808 08:34:28.718367 14074 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:28.718511 14074 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:28.718694 14074 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:28.721333 14074 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96f6fe5fc1ef4642be9ea15146a21b92" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39653 } }
I20260808 08:34:28.721846 14074 leader_election.cc:302] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96f6fe5fc1ef4642be9ea15146a21b92; no voters:
I20260808 08:34:28.722463 14074 leader_election.cc:288] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:28.722600 14079 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:28.723366 14079 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [term 1 LEADER]: Becoming Leader. State: Replica: 96f6fe5fc1ef4642be9ea15146a21b92, State: Running, Role: LEADER
I20260808 08:34:28.723896 14079 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96f6fe5fc1ef4642be9ea15146a21b92" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39653 } }
I20260808 08:34:28.724547 14074 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:28.726872 14080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96f6fe5fc1ef4642be9ea15146a21b92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96f6fe5fc1ef4642be9ea15146a21b92" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39653 } } }
I20260808 08:34:28.727380 14080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:28.727666 14081 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96f6fe5fc1ef4642be9ea15146a21b92. Latest consensus state: current_term: 1 leader_uuid: "96f6fe5fc1ef4642be9ea15146a21b92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96f6fe5fc1ef4642be9ea15146a21b92" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39653 } } }
I20260808 08:34:28.727945 14081 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:28.730219 14087 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:28.735339 14087 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:28.744102 14087 catalog_manager.cc:1347] Generated new cluster ID: d01488de938e43ea949245c8a660b7db
I20260808 08:34:28.744293 14087 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:28.770298 14087 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:28.772367 14087 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:28.785281 14087 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92: Generated new TSK 0
I20260808 08:34:28.786216 14087 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.193.keytab.
Entry for principal oryx/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.193.keytab.
I20260808 08:34:28.861037 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39653
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.193.keytab
--principal=oryx/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:36029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:29.206225 14102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:29.206550 14102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:29.206683 14102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:29.214417 14102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:29.214519 14102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:29.214602 14102 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:34:29.214684 14102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:34:29.224541 14102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:36029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.193.keytab
--principal=oryx/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.164.254:39653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:29.226238 14102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:29.227761 14102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:29.241611 14110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:29.241647 14107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:29.241613 14108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:29.242446 14102 server_base.cc:1034] running on GCE node
I20260808 08:34:29.243059 14102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:29.244102 14102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:29.245323 14102 hybrid_clock.cc:648] HybridClock initialized: now 1786178069245260 us; error 31 us; skew 500 ppm
I20260808 08:34:29.245635 14102 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:29 dist-test-slave-chsk krb5kdc[13971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178069, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:29.248989 14102 init.cc:377] Logged in from keytab as oryx/127.5.164.193@KRBTEST.COM (short username oryx)
I20260808 08:34:29.250350 14102 webserver.cc:460] Webserver started at http://127.5.164.193:41851/ using document root <none> and password file <none>
I20260808 08:34:29.251011 14102 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:29.251102 14102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:29.251477 14102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:29.254336 14102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "b580fcd1b2fa441eb91bc8339a91a160"
format_stamp: "Formatted at 2026-08-08 08:34:29 on dist-test-slave-chsk"
server_key: "bd71bdb64a8744718f1093cdbc9c1cab"
server_key_iv: "d3cd2a4d5dc6e0c06481fde9dc3afb81"
server_key_version: "encryptionkey@0"
I20260808 08:34:29.255075 14102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "b580fcd1b2fa441eb91bc8339a91a160"
format_stamp: "Formatted at 2026-08-08 08:34:29 on dist-test-slave-chsk"
server_key: "bd71bdb64a8744718f1093cdbc9c1cab"
server_key_iv: "d3cd2a4d5dc6e0c06481fde9dc3afb81"
server_key_version: "encryptionkey@0"
I20260808 08:34:29.260174 14102 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 08:34:29.263470 14117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:29.264724 14102 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:34:29.264894 14102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "b580fcd1b2fa441eb91bc8339a91a160"
format_stamp: "Formatted at 2026-08-08 08:34:29 on dist-test-slave-chsk"
server_key: "bd71bdb64a8744718f1093cdbc9c1cab"
server_key_iv: "d3cd2a4d5dc6e0c06481fde9dc3afb81"
server_key_version: "encryptionkey@0"
I20260808 08:34:29.265110 14102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:29.282481 14102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:29.287324 14102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:29.287636 14102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:29.290374 14102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:29.290493 14102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:29.290658 14102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:29.290736 14102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:34:29 dist-test-slave-chsk krb5kdc[13971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178069, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM
I20260808 08:34:29.319023 14126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:29.291185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:41985 (local address 127.5.164.254:39653)
0808 08:34:29.291760 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:29.291768 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:29.292986 (+ 1218us) server_negotiation.cc:407] Connection header received
0808 08:34:29.295515 (+ 2529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:29.295520 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:29.295631 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:29.295752 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:29.298646 (+ 2894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:29.299673 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:29.303210 (+ 3537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:29.304030 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:29.304170 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:29.310613 (+ 6443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:29.310623 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:29.310632 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:29.310691 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:29.314833 (+ 4142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:29.316082 (+ 1249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:29.316088 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:29.316094 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:29.316235 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:29.317004 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:29.317011 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:29.317017 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:29.317390 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:29.317573 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:29.318371 (+ 798us) server_negotiation.cc:299] Negotiation successful
0808 08:34:29.318630 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":324,"threads_started":1}
I20260808 08:34:29.320214 14127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:29.291861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39653 (local address 127.5.164.193:41985)
0808 08:34:29.292793 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:29.292852 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:29.295105 (+ 2253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:29.296098 (+ 993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:29.296113 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:29.297311 (+ 1198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:29.298400 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:29.298438 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:29.299870 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:29.299882 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:29.302912 (+ 3030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:29.302930 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:29.304652 (+ 1722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:29.304665 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:29.305039 (+ 374us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:29.306036 (+ 997us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:29.306078 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:29.310219 (+ 4141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:29.315034 (+ 4815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:29.315045 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:29.315066 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:29.315867 (+ 801us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:29.316422 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:29.316427 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:29.316431 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:29.316829 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:29.317555 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:29.317564 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:29.317963 (+ 399us) client_negotiation.cc:769] Sending connection context
0808 08:34:29.318246 (+ 283us) client_negotiation.cc:240] Negotiation successful
0808 08:34:29.318834 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"thread_start_us":402,"threads_started":1}
I20260808 08:34:29.340543 14102 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:42257
I20260808 08:34:29.340585 14251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:42257 every 8 connection(s)
I20260808 08:34:29.342175 14102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:34:29.344698 14252 heartbeater.cc:347] Connected to a master server at 127.5.164.254:39653
I20260808 08:34:29.344978 14252 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:29.345767 14252 heartbeater.cc:511] Master 127.5.164.254:39653 requested a full tablet report, sending...
I20260808 08:34:29.347734 14126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:29.330774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:49895 (local address 127.5.164.254:39653)
0808 08:34:29.330944 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:29.330949 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:29.331669 (+ 720us) server_negotiation.cc:407] Connection header received
0808 08:34:29.331901 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:29.331907 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:29.331983 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:29.332120 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:29.334192 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:29.335468 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:29.338249 (+ 2781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:29.338743 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:29.338844 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:29.341589 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:29.341594 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:29.341597 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:29.341632 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:29.344762 (+ 3130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:29.345559 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:29.345566 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:29.345571 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:29.345740 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:29.346190 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:29.346195 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:29.346198 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:29.346600 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:29.346799 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:29.347286 (+ 487us) server_negotiation.cc:299] Negotiation successful
0808 08:34:29.347467 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 08:34:29.348011 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:29.330824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39653 (local address 127.5.164.193:49895)
0808 08:34:29.331556 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:29.331573 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:29.331754 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:29.332204 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:29.332211 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:29.333156 (+ 945us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:29.333892 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:29.333919 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:29.335660 (+ 1741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:29.335669 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:29.338041 (+ 2372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:29.338069 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:29.338974 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:29.338992 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:29.339247 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:29.340141 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:29.340170 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:29.341379 (+ 1209us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:29.344893 (+ 3514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:29.344898 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:29.344902 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:29.345419 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:29.345904 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:29.345910 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:29.345916 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:29.346073 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:29.346770 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:29.346775 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:29.346971 (+ 196us) client_negotiation.cc:769] Sending connection context
0808 08:34:29.347197 (+ 226us) client_negotiation.cc:240] Negotiation successful
0808 08:34:29.347564 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":449,"threads_started":1}
I20260808 08:34:29.348408 14021 ts_manager.cc:194] Registered new tserver with Master: b580fcd1b2fa441eb91bc8339a91a160 (127.5.164.193:42257)
I20260808 08:34:29.350091 14021 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:41985
I20260808 08:34:29.350701 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 14102
I20260808 08:34:29.350924 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:34:29.352195 5779 external_mini_cluster.cc:1428] Setting key 975b979c60ad6e5ba53ab9e796b63681
WARNING: no policy specified for oryx/127.5.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.194.keytab.
Entry for principal oryx/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.194.keytab.
I20260808 08:34:29.414753 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39653
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.194.keytab
--principal=oryx/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:36029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:29.829406 14258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:29.829785 14258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:29.829999 14258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:29.837961 14258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:29.838133 14258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:29.838284 14258 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:34:29.838426 14258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:34:29.849189 14258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:36029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.194.keytab
--principal=oryx/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.164.254:39653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:29.850601 14258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:29.852092 14258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:29.865758 14265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:29.865705 14267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:29.865793 14264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:29.866959 14258 server_base.cc:1034] running on GCE node
I20260808 08:34:29.867642 14258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:29.868634 14258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:29.869956 14258 hybrid_clock.cc:648] HybridClock initialized: now 1786178069869847 us; error 35 us; skew 500 ppm
I20260808 08:34:29.870334 14258 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:29 dist-test-slave-chsk krb5kdc[13971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178069, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:29.873554 14258 init.cc:377] Logged in from keytab as oryx/127.5.164.194@KRBTEST.COM (short username oryx)
I20260808 08:34:29.875007 14258 webserver.cc:460] Webserver started at http://127.5.164.194:46529/ using document root <none> and password file <none>
I20260808 08:34:29.875773 14258 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:29.875913 14258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:29.876243 14258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:29.879223 14258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "ecff1897b94b4c8ab35b6bc8666952ac"
format_stamp: "Formatted at 2026-08-08 08:34:29 on dist-test-slave-chsk"
server_key: "ab8732295ce4cf0bab7e9e77ce8ecc08"
server_key_iv: "cf8f7733c0bac80414344d194a5c36d4"
server_key_version: "encryptionkey@0"
I20260808 08:34:29.880055 14258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "ecff1897b94b4c8ab35b6bc8666952ac"
format_stamp: "Formatted at 2026-08-08 08:34:29 on dist-test-slave-chsk"
server_key: "ab8732295ce4cf0bab7e9e77ce8ecc08"
server_key_iv: "cf8f7733c0bac80414344d194a5c36d4"
server_key_version: "encryptionkey@0"
I20260808 08:34:29.885279 14258 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:34:29.888827 14274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:29.890182 14258 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:34:29.890364 14258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "ecff1897b94b4c8ab35b6bc8666952ac"
format_stamp: "Formatted at 2026-08-08 08:34:29 on dist-test-slave-chsk"
server_key: "ab8732295ce4cf0bab7e9e77ce8ecc08"
server_key_iv: "cf8f7733c0bac80414344d194a5c36d4"
server_key_version: "encryptionkey@0"
I20260808 08:34:29.890614 14258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:29.917680 14258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:29.922353 14258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:29.922667 14258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:29.925783 14258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:29.925895 14258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:29.926044 14258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:29.926133 14258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:34:29 dist-test-slave-chsk krb5kdc[13971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178069, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM
I20260808 08:34:29.951874 14283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:29.926279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:60551 (local address 127.5.164.254:39653)
0808 08:34:29.928498 (+ 2219us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:29.928505 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:29.928530 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:34:29.930432 (+ 1902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:29.930438 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:29.930541 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:29.930722 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:29.932969 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:29.934394 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:29.937135 (+ 2741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:29.937582 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:29.937736 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:29.943182 (+ 5446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:29.943192 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:29.943199 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:29.943247 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:29.946593 (+ 3346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:29.948788 (+ 2195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:29.948795 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:29.948798 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:29.949019 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:29.949699 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:29.949721 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:29.949725 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:29.950163 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:29.950343 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:29.951209 (+ 866us) server_negotiation.cc:299] Negotiation successful
0808 08:34:29.951452 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2086,"thread_start_us":1985,"threads_started":1}
I20260808 08:34:29.953085 14284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:29.926990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39653 (local address 127.5.164.194:60551)
0808 08:34:29.928130 (+ 1140us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:29.928190 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:29.930106 (+ 1916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:29.930958 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:29.930965 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:29.931798 (+ 833us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:29.932701 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:29.932732 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:29.934607 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:29.934615 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:29.936961 (+ 2346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:29.936973 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:29.937843 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:29.937851 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:29.938078 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:29.939127 (+ 1049us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:29.939219 (+ 92us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:29.942901 (+ 3682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:29.946734 (+ 3833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:29.946745 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:29.946761 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:29.947532 (+ 771us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:29.949202 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:29.949209 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:29.949214 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:29.949544 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:29.950409 (+ 865us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:29.950414 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:29.950763 (+ 349us) client_negotiation.cc:769] Sending connection context
0808 08:34:29.951064 (+ 301us) client_negotiation.cc:240] Negotiation successful
0808 08:34:29.951678 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":754,"thread_start_us":428,"threads_started":1}
I20260808 08:34:29.984409 14258 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:34681
I20260808 08:34:29.984434 14407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:34681 every 8 connection(s)
I20260808 08:34:29.985150 14283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:29.970004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:35041 (local address 127.5.164.254:39653)
0808 08:34:29.970271 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:29.970281 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:29.970899 (+ 618us) server_negotiation.cc:407] Connection header received
0808 08:34:29.971120 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:29.971124 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:29.971257 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:29.971375 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:29.972964 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:29.973695 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:29.975042 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:29.975574 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:29.975721 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:29.978449 (+ 2728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:29.978456 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:29.978460 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:29.978501 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:29.982171 (+ 3670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:29.982845 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:29.982853 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:29.982860 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:29.983038 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:29.983522 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:29.983530 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:29.983533 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:29.983871 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:29.984024 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:29.984563 (+ 539us) server_negotiation.cc:299] Negotiation successful
0808 08:34:29.984796 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:34:29.985288 14377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:29.969977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39653 (local address 127.5.164.194:35041)
0808 08:34:29.970758 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:29.970785 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:29.970986 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:29.971445 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:29.971450 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:29.972208 (+ 758us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:29.972804 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:29.972820 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:29.973841 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:29.973847 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:29.974893 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:29.974904 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:29.975828 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:29.975839 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:29.976120 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:29.976980 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:29.977009 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:29.978156 (+ 1147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:29.982308 (+ 4152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:29.982312 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:29.982315 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:29.982710 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:29.983203 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:29.983208 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:29.983211 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:29.983381 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:29.984008 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:29.984013 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:29.984253 (+ 240us) client_negotiation.cc:769] Sending connection context
0808 08:34:29.984464 (+ 211us) client_negotiation.cc:240] Negotiation successful
0808 08:34:29.984838 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":392,"threads_started":1}
I20260808 08:34:29.985910 14258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:34:29.988191 14408 heartbeater.cc:347] Connected to a master server at 127.5.164.254:39653
I20260808 08:34:29.988430 14408 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:29.989144 14408 heartbeater.cc:511] Master 127.5.164.254:39653 requested a full tablet report, sending...
I20260808 08:34:29.990447 14021 ts_manager.cc:194] Registered new tserver with Master: ecff1897b94b4c8ab35b6bc8666952ac (127.5.164.194:34681)
I20260808 08:34:29.991326 14021 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:60551
I20260808 08:34:29.994796 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 14258
I20260808 08:34:29.994999 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:34:29.995561 5779 external_mini_cluster.cc:1428] Setting key 81ad180376cee5218154b45de4a4e622
WARNING: no policy specified for oryx/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.195.keytab.
Entry for principal oryx/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.195.keytab.
I20260808 08:34:30.054569 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39653
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.195.keytab
--principal=oryx/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:36029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:34:30.353442 14252 heartbeater.cc:503] Master 127.5.164.254:39653 was elected leader, sending a full tablet report...
W20260808 08:34:30.392138 14412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:30.392409 14412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:30.392575 14412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:30.400257 14412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:30.400395 14412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:30.400569 14412 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 08:34:30.400697 14412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:34:30.410480 14412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:36029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.195.keytab
--principal=oryx/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.5.164.254:39653
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:30.411890 14412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:30.413321 14412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:30.427073 14417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:30.427177 14418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:30.427100 14420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:30.428340 14412 server_base.cc:1034] running on GCE node
I20260808 08:34:30.429061 14412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:30.430069 14412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:30.431258 14412 hybrid_clock.cc:648] HybridClock initialized: now 1786178070431180 us; error 46 us; skew 500 ppm
I20260808 08:34:30.431572 14412 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:30 dist-test-slave-chsk krb5kdc[13971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178070, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:30.434895 14412 init.cc:377] Logged in from keytab as oryx/127.5.164.195@KRBTEST.COM (short username oryx)
I20260808 08:34:30.436474 14412 webserver.cc:460] Webserver started at http://127.5.164.195:37375/ using document root <none> and password file <none>
I20260808 08:34:30.437443 14412 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:30.437541 14412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:30.437832 14412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:30.441095 14412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "f52d9db62da247fdba426e253e51cf39"
format_stamp: "Formatted at 2026-08-08 08:34:30 on dist-test-slave-chsk"
server_key: "ae9522e2c26c78f8c09e4e876a1732e8"
server_key_iv: "eec76c374b13cb777345e53326642be9"
server_key_version: "encryptionkey@0"
I20260808 08:34:30.441910 14412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "f52d9db62da247fdba426e253e51cf39"
format_stamp: "Formatted at 2026-08-08 08:34:30 on dist-test-slave-chsk"
server_key: "ae9522e2c26c78f8c09e4e876a1732e8"
server_key_iv: "eec76c374b13cb777345e53326642be9"
server_key_version: "encryptionkey@0"
I20260808 08:34:30.447561 14412 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260808 08:34:30.451090 14427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:30.452487 14412 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:34:30.452678 14412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "f52d9db62da247fdba426e253e51cf39"
format_stamp: "Formatted at 2026-08-08 08:34:30 on dist-test-slave-chsk"
server_key: "ae9522e2c26c78f8c09e4e876a1732e8"
server_key_iv: "eec76c374b13cb777345e53326642be9"
server_key_version: "encryptionkey@0"
I20260808 08:34:30.452916 14412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:30.469782 14412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:30.474361 14412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:30.474648 14412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:30.477442 14412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:30.477555 14412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:30.477713 14412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:30.477785 14412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:34:30 dist-test-slave-chsk krb5kdc[13971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178070, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM
I20260808 08:34:30.500319 14283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:30.477846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:53581 (local address 127.5.164.254:39653)
0808 08:34:30.478062 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:30.478069 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:30.479441 (+ 1372us) server_negotiation.cc:407] Connection header received
0808 08:34:30.481568 (+ 2127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:30.481575 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:30.481673 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:30.481845 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:30.484119 (+ 2274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.485439 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.487128 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.487916 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.488081 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:30.492745 (+ 4664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:30.492750 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:30.492754 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:30.492787 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:30.496589 (+ 3802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:30.497523 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:30.497532 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:30.497537 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:30.497731 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:30.498194 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:30.498201 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:30.498207 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:30.498710 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:30.498895 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:30.499668 (+ 773us) server_negotiation.cc:299] Negotiation successful
0808 08:34:30.499898 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:34:30.501317 14437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:30.478352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39653 (local address 127.5.164.195:53581)
0808 08:34:30.479259 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:30.479317 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:30.481278 (+ 1961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:30.482127 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:30.482144 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:30.482917 (+ 773us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:30.483845 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:30.483868 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.485632 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.485637 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:30.486963 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:30.486975 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.488203 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.488213 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:30.488451 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:30.489340 (+ 889us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:30.489377 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:30.492501 (+ 3124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:30.496743 (+ 4242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:30.496751 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:30.496770 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:30.497347 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:30.497861 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:30.497866 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:30.497870 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:30.498061 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:30.498855 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:30.498861 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:30.499265 (+ 404us) client_negotiation.cc:769] Sending connection context
0808 08:34:30.499558 (+ 293us) client_negotiation.cc:240] Negotiation successful
0808 08:34:30.500104 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":400,"threads_started":1}
I20260808 08:34:30.524138 14283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:30.507338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:33499 (local address 127.5.164.254:39653)
0808 08:34:30.507519 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:30.507527 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:30.508329 (+ 802us) server_negotiation.cc:407] Connection header received
0808 08:34:30.508532 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:30.508535 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:30.508605 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:30.508693 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:30.510143 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.510863 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.513537 (+ 2674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.514239 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.514397 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:30.517605 (+ 3208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:30.517614 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:30.517619 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:30.517667 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:30.521230 (+ 3563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:30.521960 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:30.521967 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:30.521975 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:30.522172 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:30.522565 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:30.522570 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:30.522573 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:30.522854 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:30.523011 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:30.523502 (+ 491us) server_negotiation.cc:299] Negotiation successful
0808 08:34:30.523734 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:34:30.524268 14499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:30.507431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39653 (local address 127.5.164.195:33499)
0808 08:34:30.508196 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:30.508222 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:30.508397 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:30.508760 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:30.508767 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:30.509507 (+ 740us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:30.509980 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:30.510005 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.511002 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.511011 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:30.513281 (+ 2270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:30.513304 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.514534 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.514546 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:30.514845 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:30.515776 (+ 931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:30.515802 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:30.517349 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:30.521383 (+ 4034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:30.521389 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:30.521393 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:30.521828 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:30.522294 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:30.522299 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:30.522303 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:30.522431 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:30.522975 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:30.522979 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:30.523236 (+ 257us) client_negotiation.cc:769] Sending connection context
0808 08:34:30.523388 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 08:34:30.523777 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":383,"threads_started":1}
I20260808 08:34:30.537937 14412 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:40769
I20260808 08:34:30.537961 14556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:40769 every 8 connection(s)
I20260808 08:34:30.539209 14412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:34:30.541497 14557 heartbeater.cc:347] Connected to a master server at 127.5.164.254:39653
I20260808 08:34:30.541683 14557 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:30.542318 14557 heartbeater.cc:511] Master 127.5.164.254:39653 requested a full tablet report, sending...
I20260808 08:34:30.543311 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 14412
I20260808 08:34:30.543485 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:34:30.543774 14021 ts_manager.cc:194] Registered new tserver with Master: f52d9db62da247fdba426e253e51cf39 (127.5.164.195:40769)
I20260808 08:34:30.544056 5779 external_mini_cluster.cc:1428] Setting key 84bf08c8e84652d2eab464ad403d18c2
I20260808 08:34:30.544824 14021 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:53581
I20260808 08:34:30.547320 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 08:34:30 dist-test-slave-chsk krb5kdc[13971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178070, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 08:34:30 dist-test-slave-chsk krb5kdc[13971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:30 dist-test-slave-chsk krb5kdc[13971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:30.993670 14408 heartbeater.cc:503] Master 127.5.164.254:39653 was elected leader, sending a full tablet report...
I20260808 08:34:31.547897 14557 heartbeater.cc:503] Master 127.5.164.254:39653 was elected leader, sending a full tablet report...
W20260808 08:34:31.734244 14566 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.132s user 0.000s sys 0.020s
W20260808 08:34:31.735746 14283 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:30.596827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40318 (local address 127.5.164.254:39653)
0808 08:34:30.597049 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:30.597057 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:30.597201 (+ 144us) server_negotiation.cc:407] Connection header received
0808 08:34:30.597449 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:30.597455 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:30.597543 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:30.597659 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:30.599083 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.599889 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.601161 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:30.601577 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:30.601714 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:31.735407 (+1133693us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40318: BlockingRecv error: recv got EOF from 127.0.0.1:40318 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 08 08:34:31 dist-test-slave-chsk krb5kdc[13971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178070, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM
I20260808 08:34:31.757483 14283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:31.740243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40330 (local address 127.5.164.254:39653)
0808 08:34:31.740413 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:31.740418 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:31.740802 (+ 384us) server_negotiation.cc:407] Connection header received
0808 08:34:31.740950 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:31.740954 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:31.741030 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:31.741122 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:31.742405 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:31.743225 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:31.744437 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:31.744880 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:31.744973 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:31.752157 (+ 7184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:31.752162 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:31.752166 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:31.752204 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:31.754904 (+ 2700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:31.755568 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:31.755572 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:31.755574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:31.755706 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:31.756161 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:31.756165 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:31.756168 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:31.756483 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:31.756689 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:31.756997 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 08:34:31.757181 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:34:31.761752 14020 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40330:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:34:31.768785 14020 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:34:31.808324 14583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:31.783456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46132 (local address 127.5.164.195:40769)
0808 08:34:31.798385 (+ 14929us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:31.798398 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:31.799962 (+ 1564us) server_negotiation.cc:407] Connection header received
0808 08:34:31.800270 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:31.800279 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:31.800492 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:31.800659 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:31.801581 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:31.803042 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:31.805735 (+ 2693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:31.807055 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:31.807232 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:31.807433 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:31.807776 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 08:34:31.807977 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14704,"thread_start_us":14535,"threads_started":1}
I20260808 08:34:31.808399 14579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:31.782689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:40769 (local address 127.0.0.1:46132)
0808 08:34:31.799845 (+ 17156us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:31.799864 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:31.800064 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:31.800920 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:31.800924 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:31.800947 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:31.801412 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:31.801423 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:31.803211 (+ 1788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:31.803216 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:31.805583 (+ 2367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:31.805593 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:31.807451 (+ 1858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:31.807457 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:31.807604 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:31.807628 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:34:31.807735 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 08:34:31.807978 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17015,"mutex_wait_us":81,"thread_start_us":14513,"threads_started":1}
I20260808 08:34:31.808666 14580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:31.780947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32986 (local address 127.5.164.193:42257)
0808 08:34:31.799475 (+ 18528us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:31.799481 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:31.799506 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:34:31.799585 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:31.799591 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:31.799797 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:31.800073 (+ 276us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:31.800897 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:31.802420 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:31.805544 (+ 3124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:31.807021 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:31.807943 (+ 922us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:31.808133 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:31.808208 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 08:34:31.808362 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18370,"thread_start_us":18209,"threads_started":1}
I20260808 08:34:31.809111 14581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:31.781149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32902 (local address 127.5.164.194:34681)
0808 08:34:31.798939 (+ 17790us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:31.798949 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:31.799816 (+ 867us) server_negotiation.cc:407] Connection header received
0808 08:34:31.799974 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:31.799982 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:31.800209 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:31.800415 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:31.801206 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:31.802692 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:31.805114 (+ 2422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:31.806483 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:31.806625 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:31.806853 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:31.808182 (+ 1329us) server_negotiation.cc:299] Negotiation successful
0808 08:34:31.808355 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17600,"thread_start_us":17433,"threads_started":1}
I20260808 08:34:31.809182 14578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:31.780738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42257 (local address 127.0.0.1:32986)
0808 08:34:31.796415 (+ 15677us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:31.796460 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:31.796695 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:31.800088 (+ 3393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:31.800096 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:31.800129 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:31.800679 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:31.800691 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:31.802570 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:31.802575 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:31.805358 (+ 2783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:31.805373 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:31.807297 (+ 1924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:31.807303 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:31.807517 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:31.807576 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 08:34:31.807699 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 08:34:31.808817 (+ 1118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15395,"mutex_wait_us":900,"thread_start_us":15201,"threads_started":1}
I20260808 08:34:31.811609 14582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:31.780918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:34681 (local address 127.0.0.1:32902)
0808 08:34:31.797580 (+ 16662us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:31.797604 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:31.797756 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:31.800419 (+ 2663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:31.800423 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:31.800449 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:31.800937 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:31.800946 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:31.802853 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:31.802858 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:31.804946 (+ 2088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:31.804959 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:31.807014 (+ 2055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:31.807021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:31.807297 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:31.807815 (+ 518us) client_negotiation.cc:769] Sending connection context
0808 08:34:31.807891 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 08:34:31.808009 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16484,"mutex_wait_us":498,"thread_start_us":18658,"threads_started":1}
I20260808 08:34:31.812412 14482 tablet_service.cc:1467] Processing CreateTablet for tablet 988096322bd74b44804d6ccc2461e570 (DEFAULT_TABLE table=test-table [id=b7ee5ec7da4446c88f54856b661d1d37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:31.812678 14175 tablet_service.cc:1467] Processing CreateTablet for tablet 988096322bd74b44804d6ccc2461e570 (DEFAULT_TABLE table=test-table [id=b7ee5ec7da4446c88f54856b661d1d37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:31.813891 14175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 988096322bd74b44804d6ccc2461e570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:31.813953 14482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 988096322bd74b44804d6ccc2461e570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:31.815174 14329 tablet_service.cc:1467] Processing CreateTablet for tablet 988096322bd74b44804d6ccc2461e570 (DEFAULT_TABLE table=test-table [id=b7ee5ec7da4446c88f54856b661d1d37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:31.816565 14329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 988096322bd74b44804d6ccc2461e570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:31.828481 14585 tablet_bootstrap.cc:492] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39: Bootstrap starting.
I20260808 08:34:31.829229 14584 tablet_bootstrap.cc:492] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160: Bootstrap starting.
I20260808 08:34:31.832381 14585 tablet_bootstrap.cc:654] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:31.832458 14586 tablet_bootstrap.cc:492] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac: Bootstrap starting.
I20260808 08:34:31.832930 14584 tablet_bootstrap.cc:654] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:31.833942 14584 log.cc:824] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:31.833967 14585 log.cc:824] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:31.836175 14586 tablet_bootstrap.cc:654] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:31.837765 14586 log.cc:824] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:31.840811 14586 tablet_bootstrap.cc:492] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac: No bootstrap required, opened a new log
I20260808 08:34:31.841100 14586 ts_tablet_manager.cc:1397] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 08:34:31.841094 14584 tablet_bootstrap.cc:492] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160: No bootstrap required, opened a new log
I20260808 08:34:31.841396 14584 ts_tablet_manager.cc:1397] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260808 08:34:31.842981 14585 tablet_bootstrap.cc:492] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39: No bootstrap required, opened a new log
I20260808 08:34:31.843314 14585 ts_tablet_manager.cc:1397] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260808 08:34:31.849262 14586 raft_consensus.cc:348] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:31.849653 14586 raft_consensus.cc:374] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:31.849759 14586 raft_consensus.cc:729] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecff1897b94b4c8ab35b6bc8666952ac, State: Initialized, Role: FOLLOWER
I20260808 08:34:31.850384 14586 consensus_queue.cc:260] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:31.852223 14586 ts_tablet_manager.cc:1428] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260808 08:34:31.852124 14584 raft_consensus.cc:348] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:31.852557 14584 raft_consensus.cc:374] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:31.852661 14584 raft_consensus.cc:729] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b580fcd1b2fa441eb91bc8339a91a160, State: Initialized, Role: FOLLOWER
I20260808 08:34:31.853596 14584 consensus_queue.cc:260] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:31.854206 14585 raft_consensus.cc:348] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:31.854662 14585 raft_consensus.cc:374] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:31.854799 14585 raft_consensus.cc:729] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f52d9db62da247fdba426e253e51cf39, State: Initialized, Role: FOLLOWER
I20260808 08:34:31.855450 14584 ts_tablet_manager.cc:1428] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160: Time spent starting tablet: real 0.014s user 0.006s sys 0.010s
I20260808 08:34:31.855502 14585 consensus_queue.cc:260] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:31.858107 14585 ts_tablet_manager.cc:1428] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39: Time spent starting tablet: real 0.015s user 0.013s sys 0.001s
W20260808 08:34:31.989092 14409 tablet.cc:2369] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:34:32.042129 14559 tablet.cc:2369] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:34:32.096230 14253 tablet.cc:2369] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:34:32.145629 14591 raft_consensus.cc:482] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:34:32.145973 14591 raft_consensus.cc:504] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.147960 14591 leader_election.cc:288] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecff1897b94b4c8ab35b6bc8666952ac (127.5.164.194:34681), f52d9db62da247fdba426e253e51cf39 (127.5.164.195:40769)
I20260808 08:34:32.155212 14583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.148449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:48527 (local address 127.5.164.195:40769)
0808 08:34:32.148694 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:32.148702 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:32.149461 (+ 759us) server_negotiation.cc:407] Connection header received
0808 08:34:32.149686 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:32.149692 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:32.149761 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:32.149830 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:32.150492 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.151311 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.153425 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.154275 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.154440 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.154518 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:32.154823 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 08:34:32.154960 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 08:34:32.155226 14581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.148384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:36763 (local address 127.5.164.194:34681)
0808 08:34:32.148629 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:32.148638 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:32.149537 (+ 899us) server_negotiation.cc:407] Connection header received
0808 08:34:32.149740 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:32.149744 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:32.149826 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:32.149925 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:32.150578 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.151360 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.153346 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.154099 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.154233 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.154287 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:32.154739 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 08:34:32.154897 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:34:32.155344 14593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.148332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:40769 (local address 127.5.164.193:48527)
0808 08:34:32.149335 (+ 1003us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:32.149351 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:32.149516 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:32.149884 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:32.149891 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:32.149928 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:32.150336 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.150346 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.151448 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.151455 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.153173 (+ 1718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.153186 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.154496 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.154501 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.154632 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.154680 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 08:34:32.154783 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 08:34:32.154906 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":853,"mutex_wait_us":19,"thread_start_us":551,"threads_started":1}
I20260808 08:34:32.155397 14594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.148439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:34681 (local address 127.5.164.193:36763)
0808 08:34:32.149373 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:32.149392 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:32.149560 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:32.149959 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:32.149966 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:32.149995 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:32.150390 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.150399 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.151522 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.151525 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.153158 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.153171 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.154328 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.154336 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.154574 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.154599 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:34:32.154675 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 08:34:32.154811 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":816,"mutex_wait_us":82,"thread_start_us":499,"threads_started":1}
I20260808 08:34:32.156692 14510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "988096322bd74b44804d6ccc2461e570" candidate_uuid: "b580fcd1b2fa441eb91bc8339a91a160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f52d9db62da247fdba426e253e51cf39" is_pre_election: true
I20260808 08:34:32.156786 14354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "988096322bd74b44804d6ccc2461e570" candidate_uuid: "b580fcd1b2fa441eb91bc8339a91a160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" is_pre_election: true
I20260808 08:34:32.157307 14510 raft_consensus.cc:2454] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b580fcd1b2fa441eb91bc8339a91a160 in term 0.
I20260808 08:34:32.157351 14354 raft_consensus.cc:2454] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b580fcd1b2fa441eb91bc8339a91a160 in term 0.
I20260808 08:34:32.157989 14119 leader_election.cc:302] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b580fcd1b2fa441eb91bc8339a91a160, f52d9db62da247fdba426e253e51cf39; no voters:
I20260808 08:34:32.158480 14591 raft_consensus.cc:2781] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:34:32.158607 14591 raft_consensus.cc:482] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:34:32.158681 14591 raft_consensus.cc:3037] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:32.160966 14591 raft_consensus.cc:504] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.161705 14591 leader_election.cc:288] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [CANDIDATE]: Term 1 election: Requested vote from peers ecff1897b94b4c8ab35b6bc8666952ac (127.5.164.194:34681), f52d9db62da247fdba426e253e51cf39 (127.5.164.195:40769)
I20260808 08:34:32.162166 14354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "988096322bd74b44804d6ccc2461e570" candidate_uuid: "b580fcd1b2fa441eb91bc8339a91a160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecff1897b94b4c8ab35b6bc8666952ac"
I20260808 08:34:32.162245 14510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "988096322bd74b44804d6ccc2461e570" candidate_uuid: "b580fcd1b2fa441eb91bc8339a91a160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f52d9db62da247fdba426e253e51cf39"
I20260808 08:34:32.162405 14354 raft_consensus.cc:3037] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:32.162485 14510 raft_consensus.cc:3037] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:32.164745 14354 raft_consensus.cc:2454] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b580fcd1b2fa441eb91bc8339a91a160 in term 1.
I20260808 08:34:32.164776 14510 raft_consensus.cc:2454] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b580fcd1b2fa441eb91bc8339a91a160 in term 1.
I20260808 08:34:32.165148 14118 leader_election.cc:302] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b580fcd1b2fa441eb91bc8339a91a160, ecff1897b94b4c8ab35b6bc8666952ac; no voters:
I20260808 08:34:32.165493 14591 raft_consensus.cc:2781] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:32.165937 14591 raft_consensus.cc:686] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [term 1 LEADER]: Becoming Leader. State: Replica: b580fcd1b2fa441eb91bc8339a91a160, State: Running, Role: LEADER
I20260808 08:34:32.166436 14591 consensus_queue.cc:237] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.171463 14020 catalog_manager.cc:5495] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 reported cstate change: term changed from 0 to 1, leader changed from <none> to b580fcd1b2fa441eb91bc8339a91a160 (127.5.164.193). New cstate: current_term: 1 leader_uuid: "b580fcd1b2fa441eb91bc8339a91a160" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } health_report { overall_health: UNKNOWN } } }
I20260808 08:34:32.264335 14580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.258059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32996 (local address 127.5.164.193:42257)
0808 08:34:32.258257 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:32.258262 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:32.258857 (+ 595us) server_negotiation.cc:407] Connection header received
0808 08:34:32.259118 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:32.259122 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:32.259265 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:32.259426 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:32.259880 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.260587 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.262064 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.262471 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.262653 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.263078 (+ 425us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:32.263693 (+ 615us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:32.263860 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:32.263964 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 08:34:32.264050 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:34:32.272785 14510 raft_consensus.cc:1261] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39 [term 1 FOLLOWER]: Refusing update from remote peer b580fcd1b2fa441eb91bc8339a91a160: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:32.272784 14354 raft_consensus.cc:1261] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Refusing update from remote peer b580fcd1b2fa441eb91bc8339a91a160: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:32.273816 14595 consensus_queue.cc:1035] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:32.274181 14591 consensus_queue.cc:1035] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:32.302544 14021 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40330:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:34:32.302901 14021 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40330:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:34:32.306468 14021 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92: Sending DeleteTablet for 3 replicas of tablet 988096322bd74b44804d6ccc2461e570
I20260808 08:34:32.307683 14175 tablet_service.cc:1514] Processing DeleteTablet for tablet 988096322bd74b44804d6ccc2461e570 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:32 UTC) from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:32986
I20260808 08:34:32.308122 14482 tablet_service.cc:1514] Processing DeleteTablet for tablet 988096322bd74b44804d6ccc2461e570 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:32 UTC) from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:46132
I20260808 08:34:32.308820 14612 tablet_replica.cc:330] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160: stopping tablet replica
I20260808 08:34:32.308818 14329 tablet_service.cc:1514] Processing DeleteTablet for tablet 988096322bd74b44804d6ccc2461e570 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:32 UTC) from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:32902
I20260808 08:34:32.309430 14612 raft_consensus.cc:2229] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:34:32.310292 14612 raft_consensus.cc:2258] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:32.311281 14021 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40330:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:34:32.312155 14021 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:34:32.319828 14614 tablet_replica.cc:330] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac: stopping tablet replica
I20260808 08:34:32.320401 14614 raft_consensus.cc:2229] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:32.321108 14175 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb9e610ad304346841c5e96d5b657ae (DEFAULT_TABLE table=test-table [id=5ff3d7a195594e2d99baf6a52ff5ffa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:32.321192 14329 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb9e610ad304346841c5e96d5b657ae (DEFAULT_TABLE table=test-table [id=5ff3d7a195594e2d99baf6a52ff5ffa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:32.321419 14481 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb9e610ad304346841c5e96d5b657ae (DEFAULT_TABLE table=test-table [id=5ff3d7a195594e2d99baf6a52ff5ffa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:32.321637 14175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb9e610ad304346841c5e96d5b657ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:32.321610 14614 raft_consensus.cc:2258] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:32.321671 14329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb9e610ad304346841c5e96d5b657ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:32.321973 14481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb9e610ad304346841c5e96d5b657ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:32.328963 14585 tablet_bootstrap.cc:492] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39: Bootstrap starting.
I20260808 08:34:32.330741 14585 tablet_bootstrap.cc:654] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:32.330786 14584 tablet_bootstrap.cc:492] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160: Bootstrap starting.
I20260808 08:34:32.332603 14584 tablet_bootstrap.cc:654] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:32.334188 14614 ts_tablet_manager.cc:1905] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:32.334424 14585 tablet_bootstrap.cc:492] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39: No bootstrap required, opened a new log
I20260808 08:34:32.334579 14585 ts_tablet_manager.cc:1397] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 08:34:32.335184 14586 tablet_bootstrap.cc:492] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac: Bootstrap starting.
I20260808 08:34:32.335913 14585 raft_consensus.cc:348] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.336140 14585 raft_consensus.cc:374] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:32.336222 14585 raft_consensus.cc:729] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f52d9db62da247fdba426e253e51cf39, State: Initialized, Role: FOLLOWER
I20260808 08:34:32.336499 14585 consensus_queue.cc:260] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.337177 14586 tablet_bootstrap.cc:654] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:32.338791 14613 tablet_replica.cc:330] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39: stopping tablet replica
I20260808 08:34:32.339427 14613 raft_consensus.cc:2229] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:32.339620 14585 ts_tablet_manager.cc:1428] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260808 08:34:32.340291 14613 raft_consensus.cc:2258] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:32.342687 14614 ts_tablet_manager.cc:1918] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:32.342847 14614 log.cc:1196] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/988096322bd74b44804d6ccc2461e570
I20260808 08:34:32.343382 14613 ts_tablet_manager.cc:1905] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:32.343484 14614 ts_tablet_manager.cc:1939] T 988096322bd74b44804d6ccc2461e570 P ecff1897b94b4c8ab35b6bc8666952ac: Deleting consensus metadata
I20260808 08:34:32.344765 14586 tablet_bootstrap.cc:492] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac: No bootstrap required, opened a new log
I20260808 08:34:32.344976 14586 ts_tablet_manager.cc:1397] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260808 08:34:32.345754 14005 catalog_manager.cc:4841] TS ecff1897b94b4c8ab35b6bc8666952ac (127.5.164.194:34681): tablet 988096322bd74b44804d6ccc2461e570 (table test-table [id=b7ee5ec7da4446c88f54856b661d1d37]) successfully deleted
I20260808 08:34:32.346794 14586 raft_consensus.cc:348] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.348165 14586 raft_consensus.cc:374] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:32.348330 14586 raft_consensus.cc:729] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecff1897b94b4c8ab35b6bc8666952ac, State: Initialized, Role: FOLLOWER
I20260808 08:34:32.348644 14586 consensus_queue.cc:260] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.349426 14586 ts_tablet_manager.cc:1428] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260808 08:34:32.351698 14612 ts_tablet_manager.cc:1905] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:32.353612 14613 ts_tablet_manager.cc:1918] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:32.353804 14613 log.cc:1196] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/988096322bd74b44804d6ccc2461e570
I20260808 08:34:32.354389 14613 ts_tablet_manager.cc:1939] T 988096322bd74b44804d6ccc2461e570 P f52d9db62da247fdba426e253e51cf39: Deleting consensus metadata
I20260808 08:34:32.356961 14006 catalog_manager.cc:4841] TS f52d9db62da247fdba426e253e51cf39 (127.5.164.195:40769): tablet 988096322bd74b44804d6ccc2461e570 (table test-table [id=b7ee5ec7da4446c88f54856b661d1d37]) successfully deleted
I20260808 08:34:32.364990 14612 ts_tablet_manager.cc:1918] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:32.365201 14612 log.cc:1196] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/988096322bd74b44804d6ccc2461e570
I20260808 08:34:32.365355 14584 tablet_bootstrap.cc:492] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160: No bootstrap required, opened a new log
I20260808 08:34:32.365535 14584 ts_tablet_manager.cc:1397] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160: Time spent bootstrapping tablet: real 0.035s user 0.023s sys 0.000s
I20260808 08:34:32.365875 14612 ts_tablet_manager.cc:1939] T 988096322bd74b44804d6ccc2461e570 P b580fcd1b2fa441eb91bc8339a91a160: Deleting consensus metadata
I20260808 08:34:32.366423 14584 raft_consensus.cc:348] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.366683 14584 raft_consensus.cc:374] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:32.366789 14584 raft_consensus.cc:729] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b580fcd1b2fa441eb91bc8339a91a160, State: Initialized, Role: FOLLOWER
I20260808 08:34:32.367086 14584 consensus_queue.cc:260] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.367799 14008 catalog_manager.cc:4841] TS b580fcd1b2fa441eb91bc8339a91a160 (127.5.164.193:42257): tablet 988096322bd74b44804d6ccc2461e570 (table test-table [id=b7ee5ec7da4446c88f54856b661d1d37]) successfully deleted
I20260808 08:34:32.368508 14584 ts_tablet_manager.cc:1428] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:32.517566 14592 raft_consensus.cc:482] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:34:32.517836 14592 raft_consensus.cc:504] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.520087 14592 leader_election.cc:288] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b580fcd1b2fa441eb91bc8339a91a160 (127.5.164.193:42257), ecff1897b94b4c8ab35b6bc8666952ac (127.5.164.194:34681)
I20260808 08:34:32.527941 14581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.521580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:41427 (local address 127.5.164.194:34681)
0808 08:34:32.521764 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:32.521772 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:32.521794 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:34:32.522039 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:32.522047 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:32.522145 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:32.522236 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:32.522999 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.523845 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.526004 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.526920 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.527112 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.527216 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:32.527501 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 08:34:32.527638 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:34:32.528019 14619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.521128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:34681 (local address 127.5.164.195:41427)
0808 08:34:32.521719 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:32.521738 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:32.521837 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:32.522483 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:32.522489 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:32.522520 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:32.522855 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.522863 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.523978 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.523985 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.525830 (+ 1845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.525843 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.527174 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.527181 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.527344 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.527368 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:34:32.527474 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 08:34:32.527605 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":51,"thread_start_us":935,"threads_started":1}
I20260808 08:34:32.528671 14354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb9e610ad304346841c5e96d5b657ae" candidate_uuid: "f52d9db62da247fdba426e253e51cf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" is_pre_election: true
I20260808 08:34:32.528959 14354 raft_consensus.cc:2454] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f52d9db62da247fdba426e253e51cf39 in term 0.
I20260808 08:34:32.529429 14580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.520873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:55239 (local address 127.5.164.193:42257)
0808 08:34:32.521069 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:32.521075 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:32.521138 (+ 63us) server_negotiation.cc:407] Connection header received
0808 08:34:32.521458 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:32.521465 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:32.521604 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:32.521679 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:32.522641 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.523879 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.526597 (+ 2718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.527933 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.528087 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.528157 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:32.529039 (+ 882us) server_negotiation.cc:299] Negotiation successful
0808 08:34:32.529176 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 08:34:32.529466 14618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.520393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42257 (local address 127.5.164.195:55239)
0808 08:34:32.521044 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:32.521067 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:32.521221 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:32.521913 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:32.521917 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:32.522016 (+ 99us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:32.522450 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.522464 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.524101 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.524106 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.526401 (+ 2295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.526418 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.528657 (+ 2239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.528663 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.528844 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.528878 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:34:32.528972 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 08:34:32.529122 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":1488,"threads_started":1}
I20260808 08:34:32.530128 14428 leader_election.cc:302] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecff1897b94b4c8ab35b6bc8666952ac, f52d9db62da247fdba426e253e51cf39; no voters:
I20260808 08:34:32.530565 14592 raft_consensus.cc:2781] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:34:32.530700 14592 raft_consensus.cc:482] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:34:32.530452 14198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb9e610ad304346841c5e96d5b657ae" candidate_uuid: "f52d9db62da247fdba426e253e51cf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b580fcd1b2fa441eb91bc8339a91a160" is_pre_election: true
I20260808 08:34:32.530802 14592 raft_consensus.cc:3037] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:32.530997 14198 raft_consensus.cc:2454] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f52d9db62da247fdba426e253e51cf39 in term 0.
I20260808 08:34:32.533432 14592 raft_consensus.cc:504] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.534111 14592 leader_election.cc:288] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [CANDIDATE]: Term 1 election: Requested vote from peers b580fcd1b2fa441eb91bc8339a91a160 (127.5.164.193:42257), ecff1897b94b4c8ab35b6bc8666952ac (127.5.164.194:34681)
I20260808 08:34:32.534554 14198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb9e610ad304346841c5e96d5b657ae" candidate_uuid: "f52d9db62da247fdba426e253e51cf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b580fcd1b2fa441eb91bc8339a91a160"
I20260808 08:34:32.534777 14198 raft_consensus.cc:3037] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:32.534803 14354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb9e610ad304346841c5e96d5b657ae" candidate_uuid: "f52d9db62da247fdba426e253e51cf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecff1897b94b4c8ab35b6bc8666952ac"
I20260808 08:34:32.535012 14354 raft_consensus.cc:3037] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:32.538503 14198 raft_consensus.cc:2454] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f52d9db62da247fdba426e253e51cf39 in term 1.
I20260808 08:34:32.538944 14432 leader_election.cc:302] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b580fcd1b2fa441eb91bc8339a91a160, f52d9db62da247fdba426e253e51cf39; no voters:
I20260808 08:34:32.539309 14592 raft_consensus.cc:2781] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:32.539841 14592 raft_consensus.cc:686] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [term 1 LEADER]: Becoming Leader. State: Replica: f52d9db62da247fdba426e253e51cf39, State: Running, Role: LEADER
I20260808 08:34:32.540621 14592 consensus_queue.cc:237] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.542924 14354 raft_consensus.cc:2454] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f52d9db62da247fdba426e253e51cf39 in term 1.
I20260808 08:34:32.548919 14021 catalog_manager.cc:5495] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 reported cstate change: term changed from 0 to 1, leader changed from <none> to f52d9db62da247fdba426e253e51cf39 (127.5.164.195). New cstate: current_term: 1 leader_uuid: "f52d9db62da247fdba426e253e51cf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } health_report { overall_health: HEALTHY } } }
Aug 08 08:34:32 dist-test-slave-chsk krb5kdc[13971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178068, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.254@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM
I20260808 08:34:32.604873 14629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.589692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40346 (local address 127.5.164.254:39653)
0808 08:34:32.590919 (+ 1227us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:32.590923 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:32.590941 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:34:32.590982 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:32.590985 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:32.591040 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:32.591157 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:32.592292 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.593067 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.594398 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.594897 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.595048 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.599081 (+ 4033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:32.599086 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:32.599089 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:32.599117 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:32.601966 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:32.602706 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:32.602712 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:32.602716 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:32.602848 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:32.603257 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:32.603264 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:32.603267 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:32.603612 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:32.603768 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:32.604186 (+ 418us) server_negotiation.cc:299] Negotiation successful
0808 08:34:32.604521 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":136,"server-negotiator.queue_time_us":1133,"thread_start_us":1014,"threads_started":1}
I20260808 08:34:32.604913 14628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.589615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39653 (local address 127.0.0.1:40346)
0808 08:34:32.590335 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:32.590358 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:32.590475 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:32.591206 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:32.591210 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:32.591911 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:32.592125 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.592134 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.593201 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.593206 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.594255 (+ 1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.594267 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.595189 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.595198 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.595385 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.596139 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:32.596170 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:32.598848 (+ 2678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:32.602142 (+ 3294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:32.602154 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:32.602161 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:32.602567 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:32.602957 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:32.602963 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:32.602967 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:32.603122 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:32.603741 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:32.603749 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:32.603921 (+ 172us) client_negotiation.cc:769] Sending connection context
0808 08:34:32.604087 (+ 166us) client_negotiation.cc:240] Negotiation successful
0808 08:34:32.604387 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":397,"threads_started":1}
I20260808 08:34:32.610407 14021 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:40346:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 08:34:32.611492 14021 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:34:32.619019 14329 tablet_service.cc:1467] Processing CreateTablet for tablet 2a84898fdac847ad800caa700f157ed1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=781afef568cb4bfdbf853dad6a2b79aa]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:34:32.619056 14482 tablet_service.cc:1467] Processing CreateTablet for tablet 2a84898fdac847ad800caa700f157ed1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=781afef568cb4bfdbf853dad6a2b79aa]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:34:32.619691 14329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a84898fdac847ad800caa700f157ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:32.619696 14482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a84898fdac847ad800caa700f157ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:32.623046 14175 tablet_service.cc:1467] Processing CreateTablet for tablet 2a84898fdac847ad800caa700f157ed1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=781afef568cb4bfdbf853dad6a2b79aa]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 08:34:32.623708 14175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a84898fdac847ad800caa700f157ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:32.626323 14586 tablet_bootstrap.cc:492] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac: Bootstrap starting.
I20260808 08:34:32.628185 14586 tablet_bootstrap.cc:654] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:32.632133 14585 tablet_bootstrap.cc:492] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39: Bootstrap starting.
I20260808 08:34:32.633718 14586 tablet_bootstrap.cc:492] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac: No bootstrap required, opened a new log
I20260808 08:34:32.633876 14586 ts_tablet_manager.cc:1397] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.002s
I20260808 08:34:32.633893 14585 tablet_bootstrap.cc:654] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:32.634536 14584 tablet_bootstrap.cc:492] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160: Bootstrap starting.
I20260808 08:34:32.634613 14586 raft_consensus.cc:348] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.635070 14586 raft_consensus.cc:374] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:32.635231 14586 raft_consensus.cc:729] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecff1897b94b4c8ab35b6bc8666952ac, State: Initialized, Role: FOLLOWER
I20260808 08:34:32.635607 14586 consensus_queue.cc:260] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.636353 14586 ts_tablet_manager.cc:1428] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260808 08:34:32.636204 14590 tablet_replica.cc:439] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } } }
I20260808 08:34:32.636627 14590 tablet_replica.cc:442] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:34:32.636878 14584 tablet_bootstrap.cc:654] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:32.643559 14584 tablet_bootstrap.cc:492] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160: No bootstrap required, opened a new log
I20260808 08:34:32.643759 14584 ts_tablet_manager.cc:1397] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 08:34:32.644246 14585 tablet_bootstrap.cc:492] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39: No bootstrap required, opened a new log
I20260808 08:34:32.644439 14585 ts_tablet_manager.cc:1397] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.008s
I20260808 08:34:32.644438 14584 raft_consensus.cc:348] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.644742 14584 raft_consensus.cc:374] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:32.644855 14584 raft_consensus.cc:729] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b580fcd1b2fa441eb91bc8339a91a160, State: Initialized, Role: FOLLOWER
I20260808 08:34:32.645124 14584 consensus_queue.cc:260] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.645220 14585 raft_consensus.cc:348] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.645478 14585 raft_consensus.cc:374] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:32.645572 14585 raft_consensus.cc:729] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f52d9db62da247fdba426e253e51cf39, State: Initialized, Role: FOLLOWER
I20260808 08:34:32.645751 14584 ts_tablet_manager.cc:1428] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 08:34:32.645828 14585 consensus_queue.cc:260] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.646080 14607 tablet_replica.cc:439] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } } }
I20260808 08:34:32.646315 14592 tablet_replica.cc:439] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } } }
I20260808 08:34:32.646463 14607 tablet_replica.cc:442] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:34:32.646591 14592 tablet_replica.cc:442] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:34:32.647119 14585 ts_tablet_manager.cc:1428] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 08:34:32.821564 14590 raft_consensus.cc:482] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:34:32.821815 14590 raft_consensus.cc:504] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.823397 14590 leader_election.cc:288] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b580fcd1b2fa441eb91bc8339a91a160 (127.5.164.193:42257), f52d9db62da247fdba426e253e51cf39 (127.5.164.195:40769)
I20260808 08:34:32.832345 14580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.823849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:37143 (local address 127.5.164.193:42257)
0808 08:34:32.824056 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:32.824066 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:32.824800 (+ 734us) server_negotiation.cc:407] Connection header received
0808 08:34:32.825044 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:32.825052 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:32.825143 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:32.825249 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:32.826053 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.827193 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.830387 (+ 3194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.831339 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.831524 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.831603 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:32.831918 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 08:34:32.832063 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:34:32.832510 14638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.823798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42257 (local address 127.5.164.194:37143)
0808 08:34:32.824664 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:32.824686 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:32.824848 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:32.825273 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:32.825277 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:32.825323 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:32.825818 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.825835 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.827346 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.827352 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.830169 (+ 2817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.830187 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.831534 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.831540 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.831754 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.831780 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 08:34:32.831889 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 08:34:32.832030 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":720,"mutex_wait_us":207,"thread_start_us":760,"threads_started":1}
I20260808 08:34:32.832487 14636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.823849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:43137 (local address 127.5.164.195:40769)
0808 08:34:32.824455 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:32.824462 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:32.824962 (+ 500us) server_negotiation.cc:407] Connection header received
0808 08:34:32.825139 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:32.825152 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:32.825236 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:32.825331 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:34:32.826031 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.827210 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.830375 (+ 3165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.831423 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.831655 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.831737 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:32.832042 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 08:34:32.832179 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":359,"threads_started":1}
I20260808 08:34:32.832628 14637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.823937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:40769 (local address 127.5.164.194:43137)
0808 08:34:32.824857 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:32.824872 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:32.824973 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:32.825350 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:32.825357 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:32.825385 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:34:32.825896 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.825905 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.827346 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.827351 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.830169 (+ 2818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.830186 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.831699 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.831706 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.831875 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.831900 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:34:32.832013 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 08:34:32.832164 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":813,"mutex_wait_us":232,"thread_start_us":461,"threads_started":1}
I20260808 08:34:32.833372 14198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a84898fdac847ad800caa700f157ed1" candidate_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b580fcd1b2fa441eb91bc8339a91a160" is_pre_election: true
I20260808 08:34:32.833684 14198 raft_consensus.cc:2454] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecff1897b94b4c8ab35b6bc8666952ac in term 0.
I20260808 08:34:32.833644 14510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a84898fdac847ad800caa700f157ed1" candidate_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f52d9db62da247fdba426e253e51cf39" is_pre_election: true
I20260808 08:34:32.833902 14510 raft_consensus.cc:2454] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecff1897b94b4c8ab35b6bc8666952ac in term 0.
I20260808 08:34:32.834183 14278 leader_election.cc:302] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b580fcd1b2fa441eb91bc8339a91a160, ecff1897b94b4c8ab35b6bc8666952ac; no voters:
I20260808 08:34:32.834640 14590 raft_consensus.cc:2781] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:34:32.834795 14590 raft_consensus.cc:482] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:34:32.834894 14590 raft_consensus.cc:3037] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:32.837239 14590 raft_consensus.cc:504] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.837878 14590 leader_election.cc:288] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [CANDIDATE]: Term 1 election: Requested vote from peers b580fcd1b2fa441eb91bc8339a91a160 (127.5.164.193:42257), f52d9db62da247fdba426e253e51cf39 (127.5.164.195:40769)
I20260808 08:34:32.838275 14198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a84898fdac847ad800caa700f157ed1" candidate_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b580fcd1b2fa441eb91bc8339a91a160"
I20260808 08:34:32.838357 14510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a84898fdac847ad800caa700f157ed1" candidate_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f52d9db62da247fdba426e253e51cf39"
I20260808 08:34:32.838505 14198 raft_consensus.cc:3037] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:32.838616 14510 raft_consensus.cc:3037] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:32.840683 14198 raft_consensus.cc:2454] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecff1897b94b4c8ab35b6bc8666952ac in term 1.
I20260808 08:34:32.840782 14510 raft_consensus.cc:2454] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecff1897b94b4c8ab35b6bc8666952ac in term 1.
I20260808 08:34:32.841159 14278 leader_election.cc:302] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b580fcd1b2fa441eb91bc8339a91a160, ecff1897b94b4c8ab35b6bc8666952ac; no voters:
I20260808 08:34:32.841492 14590 raft_consensus.cc:2781] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:32.841938 14590 raft_consensus.cc:686] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [term 1 LEADER]: Becoming Leader. State: Replica: ecff1897b94b4c8ab35b6bc8666952ac, State: Running, Role: LEADER
I20260808 08:34:32.842325 14590 consensus_queue.cc:237] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:32.844288 14639 tablet_replica.cc:439] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac: TxnStatusTablet state changed. Reason: New leader ecff1897b94b4c8ab35b6bc8666952ac. Latest consensus state: current_term: 1 leader_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } } }
I20260808 08:34:32.844660 14639 tablet_replica.cc:442] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:34:32.845403 14641 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 08:34:32.845660 14641 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 08:34:32.846283 14021 catalog_manager.cc:5495] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac reported cstate change: term changed from 0 to 1, leader changed from <none> to ecff1897b94b4c8ab35b6bc8666952ac (127.5.164.194). New cstate: current_term: 1 leader_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } health_report { overall_health: UNKNOWN } } }
I20260808 08:34:32.880379 14581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.874054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32918 (local address 127.5.164.194:34681)
0808 08:34:32.874258 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:32.874267 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:32.874421 (+ 154us) server_negotiation.cc:407] Connection header received
0808 08:34:32.874707 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:32.874711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:32.874794 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:32.874908 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:32.875355 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.876109 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.878074 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.878538 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.878628 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.879249 (+ 621us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:32.879757 (+ 508us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:32.879891 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:32.880065 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 08:34:32.880149 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260808 08:34:32.880489 14628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.874053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:34681 (local address 127.0.0.1:32918)
0808 08:34:32.874320 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:32.874341 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:32.874493 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:32.874964 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:32.874972 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:32.874988 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:34:32.875216 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.875229 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.876264 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.876270 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.877912 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.877927 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.878699 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.878706 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.878934 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.879016 (+ 82us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:34:32.879874 (+ 858us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:34:32.879898 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:34:32.879997 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 08:34:32.880160 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 08:34:32.885183 14510 raft_consensus.cc:1261] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39 [term 1 FOLLOWER]: Refusing update from remote peer ecff1897b94b4c8ab35b6bc8666952ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:32.885515 14198 raft_consensus.cc:1261] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160 [term 1 FOLLOWER]: Refusing update from remote peer ecff1897b94b4c8ab35b6bc8666952ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:32.885921 14639 consensus_queue.cc:1035] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:32.886301 14590 consensus_queue.cc:1035] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:32.892046 14592 tablet_replica.cc:439] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39: TxnStatusTablet state changed. Reason: New leader ecff1897b94b4c8ab35b6bc8666952ac. Latest consensus state: current_term: 1 leader_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } } }
I20260808 08:34:32.892392 14592 tablet_replica.cc:442] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:34:32.895817 14645 mvcc.cc:205] Tried to move back new op lower bound from 7316185386530865152 to 7316185386366033920. Current Snapshot: MvccSnapshot[applied={T|T < 7316185386530865152}]
I20260808 08:34:32.896057 14644 mvcc.cc:205] Tried to move back new op lower bound from 7316185386530865152 to 7316185386366033920. Current Snapshot: MvccSnapshot[applied={T|T < 7316185386530865152}]
I20260808 08:34:32.908906 14592 tablet_replica.cc:439] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } } }
I20260808 08:34:32.909246 14592 tablet_replica.cc:442] T 2a84898fdac847ad800caa700f157ed1 P f52d9db62da247fdba426e253e51cf39: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:34:32.909988 14590 tablet_replica.cc:439] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } } }
I20260808 08:34:32.910290 14590 tablet_replica.cc:442] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:34:32.913035 14607 tablet_replica.cc:439] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160: TxnStatusTablet state changed. Reason: New leader ecff1897b94b4c8ab35b6bc8666952ac. Latest consensus state: current_term: 1 leader_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } } }
I20260808 08:34:32.913368 14607 tablet_replica.cc:442] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:34:32.915678 14639 tablet_replica.cc:439] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } } }
I20260808 08:34:32.915931 14639 tablet_replica.cc:442] T 2a84898fdac847ad800caa700f157ed1 P ecff1897b94b4c8ab35b6bc8666952ac: This TxnStatusTablet replica's current role is: LEADER
I20260808 08:34:32.916256 14646 mvcc.cc:205] Tried to move back new op lower bound from 7316185386530865152 to 7316185386366033920. Current Snapshot: MvccSnapshot[applied={T|T < 7316185386530865152}]
I20260808 08:34:32.917896 14607 tablet_replica.cc:439] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } } }
I20260808 08:34:32.918124 14607 tablet_replica.cc:442] T 2a84898fdac847ad800caa700f157ed1 P b580fcd1b2fa441eb91bc8339a91a160: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 08:34:32.934630 14636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.928444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46144 (local address 127.5.164.195:40769)
0808 08:34:32.928649 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:32.928654 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:32.929194 (+ 540us) server_negotiation.cc:407] Connection header received
0808 08:34:32.929469 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:32.929474 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:32.929598 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:32.929768 (+ 170us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:32.930229 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.931086 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.932453 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.932879 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.933020 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.933444 (+ 424us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:32.933989 (+ 545us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:32.934148 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:32.934250 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 08:34:32.934337 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:34:32.951843 14581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.945378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:42011 (local address 127.5.164.194:34681)
0808 08:34:32.945574 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:32.945581 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:32.946157 (+ 576us) server_negotiation.cc:407] Connection header received
0808 08:34:32.946358 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:32.946364 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:32.946452 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:32.946550 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:32.947039 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.948220 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.949594 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.950405 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.950542 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.951019 (+ 477us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:32.951117 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:32.951303 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:32.951408 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 08:34:32.951488 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:34:32.951786 14592 consensus_queue.cc:1035] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:32.952147 14659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.945374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:34681 (local address 127.5.164.195:42011)
0808 08:34:32.946057 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:32.946073 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:32.946188 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:32.946571 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:32.946574 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:32.946584 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:34:32.946882 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.946890 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.948354 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.948358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.949450 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:32.949462 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:32.950595 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:32.950602 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:32.950783 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:32.950836 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:34:32.951299 (+ 463us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:34:32.951312 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 08:34:32.951387 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 08:34:32.951517 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":377,"threads_started":1}
I20260808 08:34:32.963090 14620 consensus_queue.cc:1035] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:33.010524 14636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.997407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:54511 (local address 127.5.164.195:40769)
0808 08:34:32.997584 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:32.997590 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:33.003732 (+ 6142us) server_negotiation.cc:407] Connection header received
0808 08:34:33.003929 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:33.003935 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:33.004035 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:33.004128 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:33.004831 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:33.005976 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:33.008325 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:33.008975 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:33.009063 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:33.009755 (+ 692us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:33.009884 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:33.009938 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:33.010148 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 08:34:33.010229 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:34:33.011391 14663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:32.996982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:40769 (local address 127.5.164.194:54511)
0808 08:34:33.003594 (+ 6612us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:33.003615 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:33.003786 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:33.004169 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:33.004175 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:33.004187 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 08:34:33.004656 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:33.004670 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:33.006132 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:33.006137 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:33.008150 (+ 2013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:33.008173 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:33.009268 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:33.009274 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:33.009442 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:33.009511 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 08:34:33.010016 (+ 505us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 08:34:33.010026 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 08:34:33.010781 (+ 755us) client_negotiation.cc:240] Negotiation successful
0808 08:34:33.010931 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6341,"thread_start_us":6172,"threads_started":1}
I20260808 08:34:33.073115 14020 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40330:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:34:33.073455 14020 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40330:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:34:33.077239 14020 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92: Sending DeleteTablet for 3 replicas of tablet 7fb9e610ad304346841c5e96d5b657ae
I20260808 08:34:33.078298 14175 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fb9e610ad304346841c5e96d5b657ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:33 UTC) from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:32986
I20260808 08:34:33.078378 14329 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fb9e610ad304346841c5e96d5b657ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:33 UTC) from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:32902
I20260808 08:34:33.079083 14482 tablet_service.cc:1514] Processing DeleteTablet for tablet 7fb9e610ad304346841c5e96d5b657ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:33 UTC) from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:46132
I20260808 08:34:33.102041 14667 tablet_replica.cc:330] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160: stopping tablet replica
I20260808 08:34:33.102352 14670 tablet_replica.cc:330] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39: stopping tablet replica
I20260808 08:34:33.102677 14670 raft_consensus.cc:2229] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:34:33.102907 14667 raft_consensus.cc:2229] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:33.103629 14667 raft_consensus.cc:2258] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:33.103691 14670 raft_consensus.cc:2258] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:33.105022 14670 ts_tablet_manager.cc:1905] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:33.105360 14667 ts_tablet_manager.cc:1905] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:33.110669 14668 tablet_replica.cc:330] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac: stopping tablet replica
I20260808 08:34:33.111060 14668 raft_consensus.cc:2229] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:33.111491 14668 raft_consensus.cc:2258] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:33.112761 14668 ts_tablet_manager.cc:1905] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:33.112950 14670 ts_tablet_manager.cc:1918] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:34:33.113178 14670 log.cc:1196] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/7fb9e610ad304346841c5e96d5b657ae
I20260808 08:34:33.113816 14670 ts_tablet_manager.cc:1939] T 7fb9e610ad304346841c5e96d5b657ae P f52d9db62da247fdba426e253e51cf39: Deleting consensus metadata
I20260808 08:34:33.115113 14006 catalog_manager.cc:4841] TS f52d9db62da247fdba426e253e51cf39 (127.5.164.195:40769): tablet 7fb9e610ad304346841c5e96d5b657ae (table test-table [id=5ff3d7a195594e2d99baf6a52ff5ffa6]) successfully deleted
I20260808 08:34:33.125494 14667 ts_tablet_manager.cc:1918] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:34:33.125849 14667 log.cc:1196] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/7fb9e610ad304346841c5e96d5b657ae
I20260808 08:34:33.126425 14667 ts_tablet_manager.cc:1939] T 7fb9e610ad304346841c5e96d5b657ae P b580fcd1b2fa441eb91bc8339a91a160: Deleting consensus metadata
I20260808 08:34:33.127856 14008 catalog_manager.cc:4841] TS b580fcd1b2fa441eb91bc8339a91a160 (127.5.164.193:42257): tablet 7fb9e610ad304346841c5e96d5b657ae (table test-table [id=5ff3d7a195594e2d99baf6a52ff5ffa6]) successfully deleted
I20260808 08:34:33.129102 14668 ts_tablet_manager.cc:1918] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:34:33.129439 14668 log.cc:1196] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/7fb9e610ad304346841c5e96d5b657ae
I20260808 08:34:33.130017 14668 ts_tablet_manager.cc:1939] T 7fb9e610ad304346841c5e96d5b657ae P ecff1897b94b4c8ab35b6bc8666952ac: Deleting consensus metadata
I20260808 08:34:33.131381 14005 catalog_manager.cc:4841] TS ecff1897b94b4c8ab35b6bc8666952ac (127.5.164.194:34681): tablet 7fb9e610ad304346841c5e96d5b657ae (table test-table [id=5ff3d7a195594e2d99baf6a52ff5ffa6]) successfully deleted
Aug 08 08:34:33 dist-test-slave-chsk krb5kdc[13971](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 08:34:33 dist-test-slave-chsk krb5kdc[13971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:33 dist-test-slave-chsk krb5kdc[13971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:34:33.192687 14678 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:33.165130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40350 (local address 127.5.164.254:39653)
0808 08:34:33.181234 (+ 16104us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:33.181246 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:33.181926 (+ 680us) server_negotiation.cc:407] Connection header received
0808 08:34:33.182213 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:33.182221 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:33.182308 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:33.182440 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:33.184058 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:33.184846 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:33.186138 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:33.186572 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:33.186717 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:33.192451 (+ 5734us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40350: BlockingRecv error: recv got EOF from 127.0.0.1:40350 (error 108)
Metrics: {"server-negotiator.queue_time_us":15883,"thread_start_us":16632,"threads_started":1}
Aug 08 08:34:33 dist-test-slave-chsk krb5kdc[13971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM
I20260808 08:34:33.211732 14678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:33.197163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40364 (local address 127.5.164.254:39653)
0808 08:34:33.197338 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:33.197345 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:33.197564 (+ 219us) server_negotiation.cc:407] Connection header received
0808 08:34:33.197776 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:33.197782 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:33.197860 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:33.197967 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:33.199246 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:33.200017 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:33.201290 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:33.201874 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:33.202026 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:33.206181 (+ 4155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:33.206186 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:33.206190 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:33.206223 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:33.209046 (+ 2823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:33.209701 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:33.209708 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:33.209712 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:33.209849 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:33.210231 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:33.210237 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:33.210240 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:33.210509 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:33.210795 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:33.211086 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 08:34:33.211352 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 08:34:33.215461 14020 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40364:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:34:33.216121 14020 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:34:33.223301 14175 tablet_service.cc:1467] Processing CreateTablet for tablet 7754a063fdf14a269bfc6f7af042f0a0 (DEFAULT_TABLE table=test-table [id=f72aa41b4c5846e5b181512ec21e5492]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:33.223814 14175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7754a063fdf14a269bfc6f7af042f0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:33.223778 14329 tablet_service.cc:1467] Processing CreateTablet for tablet 7754a063fdf14a269bfc6f7af042f0a0 (DEFAULT_TABLE table=test-table [id=f72aa41b4c5846e5b181512ec21e5492]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:33.224236 14329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7754a063fdf14a269bfc6f7af042f0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:33.230389 14482 tablet_service.cc:1467] Processing CreateTablet for tablet 7754a063fdf14a269bfc6f7af042f0a0 (DEFAULT_TABLE table=test-table [id=f72aa41b4c5846e5b181512ec21e5492]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:33.230991 14482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7754a063fdf14a269bfc6f7af042f0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:33.250700 14686 tablet_bootstrap.cc:492] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160: Bootstrap starting.
I20260808 08:34:33.251384 14688 tablet_bootstrap.cc:492] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39: Bootstrap starting.
I20260808 08:34:33.253531 14688 tablet_bootstrap.cc:654] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:33.255656 14687 tablet_bootstrap.cc:492] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac: Bootstrap starting.
I20260808 08:34:33.257295 14686 tablet_bootstrap.cc:654] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:33.260504 14687 tablet_bootstrap.cc:654] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:33.262846 14686 tablet_bootstrap.cc:492] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160: No bootstrap required, opened a new log
I20260808 08:34:33.263025 14686 ts_tablet_manager.cc:1397] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260808 08:34:33.263432 14688 tablet_bootstrap.cc:492] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39: No bootstrap required, opened a new log
I20260808 08:34:33.263628 14688 ts_tablet_manager.cc:1397] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.004s
I20260808 08:34:33.264700 14688 raft_consensus.cc:348] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.265056 14688 raft_consensus.cc:374] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:33.265175 14688 raft_consensus.cc:729] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f52d9db62da247fdba426e253e51cf39, State: Initialized, Role: FOLLOWER
I20260808 08:34:33.266268 14686 raft_consensus.cc:348] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.267198 14686 raft_consensus.cc:374] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:33.267315 14686 raft_consensus.cc:729] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b580fcd1b2fa441eb91bc8339a91a160, State: Initialized, Role: FOLLOWER
I20260808 08:34:33.267627 14686 consensus_queue.cc:260] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.269711 14688 consensus_queue.cc:260] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.270548 14688 ts_tablet_manager.cc:1428] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20260808 08:34:33.271028 14686 ts_tablet_manager.cc:1428] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s
I20260808 08:34:33.273916 14687 tablet_bootstrap.cc:492] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac: No bootstrap required, opened a new log
I20260808 08:34:33.274114 14687 ts_tablet_manager.cc:1397] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.013s
I20260808 08:34:33.274824 14687 raft_consensus.cc:348] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.275058 14687 raft_consensus.cc:374] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:33.275221 14687 raft_consensus.cc:729] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecff1897b94b4c8ab35b6bc8666952ac, State: Initialized, Role: FOLLOWER
I20260808 08:34:33.275520 14687 consensus_queue.cc:260] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.276084 14687 ts_tablet_manager.cc:1428] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 08:34:33.362169 14607 raft_consensus.cc:482] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:34:33.362396 14607 raft_consensus.cc:504] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.363890 14354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7754a063fdf14a269bfc6f7af042f0a0" candidate_uuid: "b580fcd1b2fa441eb91bc8339a91a160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" is_pre_election: true
I20260808 08:34:33.364156 14354 raft_consensus.cc:2454] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b580fcd1b2fa441eb91bc8339a91a160 in term 0.
I20260808 08:34:33.364749 14510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7754a063fdf14a269bfc6f7af042f0a0" candidate_uuid: "b580fcd1b2fa441eb91bc8339a91a160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f52d9db62da247fdba426e253e51cf39" is_pre_election: true
I20260808 08:34:33.365022 14510 raft_consensus.cc:2454] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b580fcd1b2fa441eb91bc8339a91a160 in term 0.
I20260808 08:34:33.365137 14607 leader_election.cc:288] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecff1897b94b4c8ab35b6bc8666952ac (127.5.164.194:34681), f52d9db62da247fdba426e253e51cf39 (127.5.164.195:40769)
I20260808 08:34:33.365329 14118 leader_election.cc:302] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b580fcd1b2fa441eb91bc8339a91a160, ecff1897b94b4c8ab35b6bc8666952ac; no voters:
I20260808 08:34:33.365576 14607 raft_consensus.cc:2781] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:34:33.365701 14607 raft_consensus.cc:482] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:34:33.365777 14607 raft_consensus.cc:3037] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:33.368755 14607 raft_consensus.cc:504] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.369886 14354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7754a063fdf14a269bfc6f7af042f0a0" candidate_uuid: "b580fcd1b2fa441eb91bc8339a91a160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecff1897b94b4c8ab35b6bc8666952ac"
I20260808 08:34:33.370102 14354 raft_consensus.cc:3037] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:33.373039 14354 raft_consensus.cc:2454] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b580fcd1b2fa441eb91bc8339a91a160 in term 1.
I20260808 08:34:33.373533 14118 leader_election.cc:302] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b580fcd1b2fa441eb91bc8339a91a160, ecff1897b94b4c8ab35b6bc8666952ac; no voters:
I20260808 08:34:33.375550 14510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7754a063fdf14a269bfc6f7af042f0a0" candidate_uuid: "b580fcd1b2fa441eb91bc8339a91a160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f52d9db62da247fdba426e253e51cf39"
I20260808 08:34:33.375777 14510 raft_consensus.cc:3037] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:33.377189 14607 leader_election.cc:288] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [CANDIDATE]: Term 1 election: Requested vote from peers ecff1897b94b4c8ab35b6bc8666952ac (127.5.164.194:34681), f52d9db62da247fdba426e253e51cf39 (127.5.164.195:40769)
I20260808 08:34:33.377552 14607 raft_consensus.cc:2781] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:33.377954 14607 raft_consensus.cc:686] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [term 1 LEADER]: Becoming Leader. State: Replica: b580fcd1b2fa441eb91bc8339a91a160, State: Running, Role: LEADER
I20260808 08:34:33.378468 14607 consensus_queue.cc:237] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.379293 14510 raft_consensus.cc:2454] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b580fcd1b2fa441eb91bc8339a91a160 in term 1.
I20260808 08:34:33.381798 14021 catalog_manager.cc:5495] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 reported cstate change: term changed from 0 to 1, leader changed from <none> to b580fcd1b2fa441eb91bc8339a91a160 (127.5.164.193). New cstate: current_term: 1 leader_uuid: "b580fcd1b2fa441eb91bc8339a91a160" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } health_report { overall_health: UNKNOWN } } }
I20260808 08:34:33.406507 14695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:33.400387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33004 (local address 127.5.164.193:42257)
0808 08:34:33.401029 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:33.401033 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:33.401054 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:34:33.401115 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:33.401119 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:33.401180 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:33.401265 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:33.401670 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:33.402611 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:33.404567 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:33.405023 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:33.405125 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:33.405705 (+ 580us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:33.405810 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:33.405882 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:33.406072 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 08:34:33.406140 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":379,"threads_started":1}
I20260808 08:34:33.409330 14354 raft_consensus.cc:1261] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Refusing update from remote peer b580fcd1b2fa441eb91bc8339a91a160: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:33.410157 14510 raft_consensus.cc:1261] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39 [term 1 FOLLOWER]: Refusing update from remote peer b580fcd1b2fa441eb91bc8339a91a160: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:33.410073 14692 consensus_queue.cc:1035] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:33.410823 14692 consensus_queue.cc:1035] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:33.424080 14021 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40364:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:34:33.424453 14021 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40364:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:34:33.429443 14021 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92: Sending DeleteTablet for 3 replicas of tablet 7754a063fdf14a269bfc6f7af042f0a0
I20260808 08:34:33.430495 14329 tablet_service.cc:1514] Processing DeleteTablet for tablet 7754a063fdf14a269bfc6f7af042f0a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:33 UTC) from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:32902
I20260808 08:34:33.430516 14175 tablet_service.cc:1514] Processing DeleteTablet for tablet 7754a063fdf14a269bfc6f7af042f0a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:33 UTC) from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:32986
I20260808 08:34:33.430833 14668 tablet_replica.cc:330] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac: stopping tablet replica
I20260808 08:34:33.430850 14667 tablet_replica.cc:330] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160: stopping tablet replica
I20260808 08:34:33.431051 14668 raft_consensus.cc:2229] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:33.431125 14667 raft_consensus.cc:2229] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:34:33.431327 14668 raft_consensus.cc:2258] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:33.431475 14667 raft_consensus.cc:2258] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:33.432304 14482 tablet_service.cc:1514] Processing DeleteTablet for tablet 7754a063fdf14a269bfc6f7af042f0a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:33 UTC) from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:46132
I20260808 08:34:33.432618 14668 ts_tablet_manager.cc:1905] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:33.432672 14670 tablet_replica.cc:330] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39: stopping tablet replica
I20260808 08:34:33.432873 14670 raft_consensus.cc:2229] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:33.433095 14670 raft_consensus.cc:2258] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:33.433589 14667 ts_tablet_manager.cc:1905] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:33.438329 14667 ts_tablet_manager.cc:1918] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:33.438453 14667 log.cc:1196] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/7754a063fdf14a269bfc6f7af042f0a0
I20260808 08:34:33.438777 14667 ts_tablet_manager.cc:1939] T 7754a063fdf14a269bfc6f7af042f0a0 P b580fcd1b2fa441eb91bc8339a91a160: Deleting consensus metadata
I20260808 08:34:33.439652 14668 ts_tablet_manager.cc:1918] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:33.439924 14668 log.cc:1196] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/7754a063fdf14a269bfc6f7af042f0a0
I20260808 08:34:33.440286 14482 tablet_service.cc:1514] Processing DeleteTablet for tablet 7754a063fdf14a269bfc6f7af042f0a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:33 UTC) from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:46132
I20260808 08:34:33.440878 14008 catalog_manager.cc:4841] TS b580fcd1b2fa441eb91bc8339a91a160 (127.5.164.193:42257): tablet 7754a063fdf14a269bfc6f7af042f0a0 (table test-table [id=f72aa41b4c5846e5b181512ec21e5492]) successfully deleted
I20260808 08:34:33.441471 14670 ts_tablet_manager.cc:1905] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:33.441676 14021 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40364:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:34:33.442494 14021 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:34:33.443425 14668 ts_tablet_manager.cc:1939] T 7754a063fdf14a269bfc6f7af042f0a0 P ecff1897b94b4c8ab35b6bc8666952ac: Deleting consensus metadata
I20260808 08:34:33.444734 14005 catalog_manager.cc:4841] TS ecff1897b94b4c8ab35b6bc8666952ac (127.5.164.194:34681): tablet 7754a063fdf14a269bfc6f7af042f0a0 (table test-table [id=f72aa41b4c5846e5b181512ec21e5492]) successfully deleted
I20260808 08:34:33.448580 14670 ts_tablet_manager.cc:1918] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:34:33.448797 14670 log.cc:1196] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/7754a063fdf14a269bfc6f7af042f0a0
I20260808 08:34:33.449215 14670 ts_tablet_manager.cc:1939] T 7754a063fdf14a269bfc6f7af042f0a0 P f52d9db62da247fdba426e253e51cf39: Deleting consensus metadata
I20260808 08:34:33.450778 14006 catalog_manager.cc:4841] TS f52d9db62da247fdba426e253e51cf39 (127.5.164.195:40769): tablet 7754a063fdf14a269bfc6f7af042f0a0 (table test-table [id=f72aa41b4c5846e5b181512ec21e5492]) successfully deleted
I20260808 08:34:33.450799 14175 tablet_service.cc:1467] Processing CreateTablet for tablet 78f2daefc7714af9b50e67f15391975f (DEFAULT_TABLE table=test-table [id=ac8b9e6953a14c64a13117cc6f968741]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:33.451367 14175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78f2daefc7714af9b50e67f15391975f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:33.451361 14482 tablet_service.cc:1467] Processing CreateTablet for tablet 78f2daefc7714af9b50e67f15391975f (DEFAULT_TABLE table=test-table [id=ac8b9e6953a14c64a13117cc6f968741]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:33.451789 14482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78f2daefc7714af9b50e67f15391975f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260808 08:34:33.451789 14006 catalog_manager.cc:4808] TS f52d9db62da247fdba426e253e51cf39 (127.5.164.195:40769): delete failed for tablet 7754a063fdf14a269bfc6f7af042f0a0 because the tablet was not found. No further retry: Not found: Tablet not found: 7754a063fdf14a269bfc6f7af042f0a0
I20260808 08:34:33.454665 14329 tablet_service.cc:1467] Processing CreateTablet for tablet 78f2daefc7714af9b50e67f15391975f (DEFAULT_TABLE table=test-table [id=ac8b9e6953a14c64a13117cc6f968741]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:34:33.455201 14329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78f2daefc7714af9b50e67f15391975f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:33.458226 14686 tablet_bootstrap.cc:492] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160: Bootstrap starting.
I20260808 08:34:33.460057 14686 tablet_bootstrap.cc:654] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:33.460202 14688 tablet_bootstrap.cc:492] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39: Bootstrap starting.
I20260808 08:34:33.462175 14688 tablet_bootstrap.cc:654] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:33.463397 14687 tablet_bootstrap.cc:492] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac: Bootstrap starting.
I20260808 08:34:33.465736 14687 tablet_bootstrap.cc:654] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:33.472733 14686 tablet_bootstrap.cc:492] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160: No bootstrap required, opened a new log
I20260808 08:34:33.473089 14686 ts_tablet_manager.cc:1397] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160: Time spent bootstrapping tablet: real 0.015s user 0.012s sys 0.001s
I20260808 08:34:33.474265 14686 raft_consensus.cc:348] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.474748 14686 raft_consensus.cc:374] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:33.474897 14686 raft_consensus.cc:729] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b580fcd1b2fa441eb91bc8339a91a160, State: Initialized, Role: FOLLOWER
I20260808 08:34:33.475293 14686 consensus_queue.cc:260] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.476104 14686 ts_tablet_manager.cc:1428] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 08:34:33.476954 14687 tablet_bootstrap.cc:492] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac: No bootstrap required, opened a new log
I20260808 08:34:33.477257 14687 ts_tablet_manager.cc:1397] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.007s
I20260808 08:34:33.477941 14687 raft_consensus.cc:348] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.478220 14687 raft_consensus.cc:374] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:33.478358 14687 raft_consensus.cc:729] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecff1897b94b4c8ab35b6bc8666952ac, State: Initialized, Role: FOLLOWER
I20260808 08:34:33.478693 14687 consensus_queue.cc:260] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.479466 14687 ts_tablet_manager.cc:1428] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260808 08:34:33.484009 14688 tablet_bootstrap.cc:492] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39: No bootstrap required, opened a new log
I20260808 08:34:33.484249 14688 ts_tablet_manager.cc:1397] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39: Time spent bootstrapping tablet: real 0.024s user 0.014s sys 0.000s
I20260808 08:34:33.485090 14688 raft_consensus.cc:348] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.485404 14688 raft_consensus.cc:374] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:33.485522 14688 raft_consensus.cc:729] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f52d9db62da247fdba426e253e51cf39, State: Initialized, Role: FOLLOWER
I20260808 08:34:33.485791 14688 consensus_queue.cc:260] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.487239 14688 ts_tablet_manager.cc:1428] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:33.867442 14620 raft_consensus.cc:482] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:34:33.867712 14620 raft_consensus.cc:504] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.868475 14620 leader_election.cc:288] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b580fcd1b2fa441eb91bc8339a91a160 (127.5.164.193:42257), ecff1897b94b4c8ab35b6bc8666952ac (127.5.164.194:34681)
I20260808 08:34:33.869091 14354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78f2daefc7714af9b50e67f15391975f" candidate_uuid: "f52d9db62da247fdba426e253e51cf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" is_pre_election: true
I20260808 08:34:33.869117 14197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78f2daefc7714af9b50e67f15391975f" candidate_uuid: "f52d9db62da247fdba426e253e51cf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b580fcd1b2fa441eb91bc8339a91a160" is_pre_election: true
I20260808 08:34:33.869345 14354 raft_consensus.cc:2454] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f52d9db62da247fdba426e253e51cf39 in term 0.
I20260808 08:34:33.869490 14197 raft_consensus.cc:2454] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f52d9db62da247fdba426e253e51cf39 in term 0.
I20260808 08:34:33.869853 14428 leader_election.cc:302] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ecff1897b94b4c8ab35b6bc8666952ac, f52d9db62da247fdba426e253e51cf39; no voters:
I20260808 08:34:33.870179 14620 raft_consensus.cc:2781] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:34:33.870271 14620 raft_consensus.cc:482] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:34:33.870352 14620 raft_consensus.cc:3037] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:33.872439 14620 raft_consensus.cc:504] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.873005 14620 leader_election.cc:288] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [CANDIDATE]: Term 1 election: Requested vote from peers b580fcd1b2fa441eb91bc8339a91a160 (127.5.164.193:42257), ecff1897b94b4c8ab35b6bc8666952ac (127.5.164.194:34681)
I20260808 08:34:33.873513 14354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78f2daefc7714af9b50e67f15391975f" candidate_uuid: "f52d9db62da247fdba426e253e51cf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecff1897b94b4c8ab35b6bc8666952ac"
I20260808 08:34:33.873538 14197 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78f2daefc7714af9b50e67f15391975f" candidate_uuid: "f52d9db62da247fdba426e253e51cf39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b580fcd1b2fa441eb91bc8339a91a160"
I20260808 08:34:33.873742 14197 raft_consensus.cc:3037] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:33.873765 14354 raft_consensus.cc:3037] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:33.876822 14197 raft_consensus.cc:2454] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f52d9db62da247fdba426e253e51cf39 in term 1.
I20260808 08:34:33.876813 14354 raft_consensus.cc:2454] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f52d9db62da247fdba426e253e51cf39 in term 1.
I20260808 08:34:33.877264 14432 leader_election.cc:302] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b580fcd1b2fa441eb91bc8339a91a160, f52d9db62da247fdba426e253e51cf39; no voters:
I20260808 08:34:33.877542 14620 raft_consensus.cc:2781] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:33.877971 14620 raft_consensus.cc:686] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [term 1 LEADER]: Becoming Leader. State: Replica: f52d9db62da247fdba426e253e51cf39, State: Running, Role: LEADER
I20260808 08:34:33.878237 14620 consensus_queue.cc:237] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } }
I20260808 08:34:33.880859 14021 catalog_manager.cc:5495] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 reported cstate change: term changed from 0 to 1, leader changed from <none> to f52d9db62da247fdba426e253e51cf39 (127.5.164.195). New cstate: current_term: 1 leader_uuid: "f52d9db62da247fdba426e253e51cf39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f52d9db62da247fdba426e253e51cf39" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40769 } health_report { overall_health: HEALTHY } } }
I20260808 08:34:33.940310 14711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:33.934640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46152 (local address 127.5.164.195:40769)
0808 08:34:33.935205 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:33.935211 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:33.935393 (+ 182us) server_negotiation.cc:407] Connection header received
0808 08:34:33.935619 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:33.935623 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:33.935683 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:33.935788 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:34:33.936272 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:33.937007 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:33.938386 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:33.938827 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:33.938969 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:33.939467 (+ 498us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:34:33.939600 (+ 133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:34:33.939717 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:33.939887 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 08:34:33.939968 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":286,"threads_started":1}
I20260808 08:34:33.949551 14354 raft_consensus.cc:1261] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Refusing update from remote peer f52d9db62da247fdba426e253e51cf39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:33.949579 14197 raft_consensus.cc:1261] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160 [term 1 FOLLOWER]: Refusing update from remote peer f52d9db62da247fdba426e253e51cf39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:34:33.950181 14701 consensus_queue.cc:1035] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b580fcd1b2fa441eb91bc8339a91a160" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:33.950485 14620 consensus_queue.cc:1035] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecff1897b94b4c8ab35b6bc8666952ac" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 34681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:34:34.008936 14019 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40364:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:34:34.009228 14019 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40364:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:34:34.012494 14019 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 96f6fe5fc1ef4642be9ea15146a21b92: Sending DeleteTablet for 3 replicas of tablet 78f2daefc7714af9b50e67f15391975f
I20260808 08:34:34.013448 14175 tablet_service.cc:1514] Processing DeleteTablet for tablet 78f2daefc7714af9b50e67f15391975f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:34 UTC) from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:32986
I20260808 08:34:34.013608 14482 tablet_service.cc:1514] Processing DeleteTablet for tablet 78f2daefc7714af9b50e67f15391975f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:34 UTC) from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:46132
I20260808 08:34:34.014060 14329 tablet_service.cc:1514] Processing DeleteTablet for tablet 78f2daefc7714af9b50e67f15391975f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:34:34 UTC) from {username='oryx', principal='oryx/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:32902
I20260808 08:34:34.014199 14719 tablet_replica.cc:330] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39: stopping tablet replica
I20260808 08:34:34.014492 14719 raft_consensus.cc:2229] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:34:34.014901 14719 raft_consensus.cc:2258] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:34.016386 14719 ts_tablet_manager.cc:1905] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:34.017757 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 14102
I20260808 08:34:34.024008 14719 ts_tablet_manager.cc:1918] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:34:34.024259 14719 log.cc:1196] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/78f2daefc7714af9b50e67f15391975f
I20260808 08:34:34.024859 14719 ts_tablet_manager.cc:1939] T 78f2daefc7714af9b50e67f15391975f P f52d9db62da247fdba426e253e51cf39: Deleting consensus metadata
I20260808 08:34:34.026073 14006 catalog_manager.cc:4841] TS f52d9db62da247fdba426e253e51cf39 (127.5.164.195:40769): tablet 78f2daefc7714af9b50e67f15391975f (table test-table [id=ac8b9e6953a14c64a13117cc6f968741]) successfully deleted
I20260808 08:34:34.030283 14718 tablet_replica.cc:330] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160: stopping tablet replica
I20260808 08:34:34.030684 14718 raft_consensus.cc:2229] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:34.030997 14718 raft_consensus.cc:2258] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:34.031279 14720 tablet_replica.cc:330] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac: stopping tablet replica
I20260808 08:34:34.031529 14720 raft_consensus.cc:2229] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:34:34.031775 14720 raft_consensus.cc:2258] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:34:34.032639 14720 ts_tablet_manager.cc:1905] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:34.032718 14718 ts_tablet_manager.cc:1905] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:34:34.038437 14718 ts_tablet_manager.cc:1918] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:34:34.038597 14718 log.cc:1196] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/78f2daefc7714af9b50e67f15391975f
I20260808 08:34:34.039021 14718 ts_tablet_manager.cc:1939] T 78f2daefc7714af9b50e67f15391975f P b580fcd1b2fa441eb91bc8339a91a160: Deleting consensus metadata
I20260808 08:34:34.039386 14720 ts_tablet_manager.cc:1918] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 08:34:34.039539 14720 log.cc:1196] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/78f2daefc7714af9b50e67f15391975f
I20260808 08:34:34.040026 14720 ts_tablet_manager.cc:1939] T 78f2daefc7714af9b50e67f15391975f P ecff1897b94b4c8ab35b6bc8666952ac: Deleting consensus metadata
I20260808 08:34:34.040273 14008 catalog_manager.cc:4841] TS b580fcd1b2fa441eb91bc8339a91a160 (127.5.164.193:42257): tablet 78f2daefc7714af9b50e67f15391975f (table test-table [id=ac8b9e6953a14c64a13117cc6f968741]) successfully deleted
I20260808 08:34:34.041127 14005 catalog_manager.cc:4841] TS ecff1897b94b4c8ab35b6bc8666952ac (127.5.164.194:34681): tablet 78f2daefc7714af9b50e67f15391975f (table test-table [id=ac8b9e6953a14c64a13117cc6f968741]) successfully deleted
Aug 08 08:34:34 dist-test-slave-chsk krb5kdc[13971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.164.193@KRBTEST.COM
I20260808 08:34:34.048575 14722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:34.019162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33010 (local address 127.5.164.193:42257)
0808 08:34:34.029969 (+ 10807us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:34.029979 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:34.030614 (+ 635us) server_negotiation.cc:407] Connection header received
0808 08:34:34.030956 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:34.030966 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:34.031092 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:34.031273 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:34.032989 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:34.034217 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:34.036111 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:34.036836 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:34.036997 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:34.042262 (+ 5265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:34.042280 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:34.042297 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:34.042333 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:34.045413 (+ 3080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:34.046104 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:34.046114 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:34.046118 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:34.046313 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:34.046858 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:34.046862 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:34.046864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:34.047338 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:34.047735 (+ 397us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:34.047955 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 08:34:34.048203 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10575,"thread_start_us":10456,"threads_started":1}
I20260808 08:34:34.049284 14246 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:34.179327 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 14102
I20260808 08:34:34.207921 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 14258
Aug 08 08:34:34 dist-test-slave-chsk krb5kdc[13971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.164.194@KRBTEST.COM
I20260808 08:34:34.225293 14725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:34.208812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32920 (local address 127.5.164.194:34681)
0808 08:34:34.209355 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:34.209360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:34.209378 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:34:34.209436 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:34.209440 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:34.209501 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:34.209604 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:34.211054 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:34.211919 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:34.213351 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:34.213765 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:34.213865 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:34.218711 (+ 4846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:34.218728 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:34.218744 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:34.218787 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:34.222306 (+ 3519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:34.223099 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:34.223107 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:34.223109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:34.223371 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:34.223751 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:34.223754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:34.223756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:34.224157 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:34.224402 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:34.224717 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 08:34:34.224969 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":298,"threads_started":1}
I20260808 08:34:34.226109 14403 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:34.354358 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 14258
I20260808 08:34:34.380446 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 14412
Aug 08 08:34:34 dist-test-slave-chsk krb5kdc[13971](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178073, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.5.164.195@KRBTEST.COM
I20260808 08:34:34.396929 14711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:34.381233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46166 (local address 127.5.164.195:40769)
0808 08:34:34.381405 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:34.381410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:34.381457 (+ 47us) server_negotiation.cc:407] Connection header received
0808 08:34:34.381627 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:34.381631 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:34.381705 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:34.381794 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:34.383659 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:34.384398 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:34.385627 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:34.386010 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:34.386114 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:34.390889 (+ 4775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:34.390908 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:34.390925 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:34.390966 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:34.394124 (+ 3158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:34.394960 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:34.394967 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:34.394970 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:34.395131 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:34.395575 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:34.395579 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:34.395581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:34.395966 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:34.396218 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:34.396457 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 08:34:34.396664 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:34:34.397619 14552 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:34.526156 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 14412
I20260808 08:34:34.551565 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 13987
I20260808 08:34:34.552836 14067 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:34.673463 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 13987
2026-08-08T08:34:34Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7884 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:34 dist-test-slave-chsk krb5kdc[14731](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:34 dist-test-slave-chsk krb5kdc[14731](info): set up 2 sockets
Aug 08 08:34:34 dist-test-slave-chsk krb5kdc[14731](info): commencing operation
krb5kdc: starting...
W20260808 08:34:35.856215 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.005s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:34:36 dist-test-slave-chsk krb5kdc[14731](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:34:36.151116 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:36673
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:33773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:36673
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:36.496797 14745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:36.497174 14745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:36.497339 14745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:36.504956 14745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:36.505124 14745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:36.505229 14745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:36.505353 14745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:36.505443 14745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:36.515825 14745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:33773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:36673
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:36673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:36.517216 14745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:36.518568 14745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:36.531188 14751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:36.531191 14754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:36.531247 14752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:36.531917 14745 server_base.cc:1034] running on GCE node
I20260808 08:34:36.532835 14745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:36.534278 14745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:36.535567 14745 hybrid_clock.cc:648] HybridClock initialized: now 1786178076535512 us; error 33 us; skew 500 ppm
I20260808 08:34:36.535972 14745 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T08:34:36Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1924 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:34:36 dist-test-slave-chsk krb5kdc[14760](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:34:36 dist-test-slave-chsk krb5kdc[14760](info): set up 2 sockets
Aug 08 08:34:36 dist-test-slave-chsk krb5kdc[14760](info): commencing operation
krb5kdc: starting...
W20260808 08:34:37.778450 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.005s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:34:37 dist-test-slave-chsk krb5kdc[14760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178077, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:34:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:34:38.077227 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:38085
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:38085
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:38.431870 14775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:38.432189 14775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:38.432370 14775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:38.439747 14775 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:38.439865 14775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:38.439960 14775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:38.440068 14775 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:38.440138 14775 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:38.450287 14775 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:38085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:38085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:38.451716 14775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:38.453069 14775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:38.465266 14785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:38.465430 14783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:38.465489 14782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:38.466591 14775 server_base.cc:1034] running on GCE node
I20260808 08:34:38.467519 14775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:38.468955 14775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:38.470165 14775 hybrid_clock.cc:648] HybridClock initialized: now 1786178078470100 us; error 50 us; skew 500 ppm
I20260808 08:34:38.470532 14775 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:38 dist-test-slave-chsk krb5kdc[14760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178078, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:38.478637 14775 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:34:38.480296 14775 webserver.cc:460] Webserver started at http://127.5.164.254:35481/ using document root <none> and password file <none>
I20260808 08:34:38.481022 14775 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:38.481154 14775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:38.481498 14775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:38.484676 14775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "907ffa45f10e485c82b483eeb696cc00"
format_stamp: "Formatted at 2026-08-08 08:34:38 on dist-test-slave-chsk"
server_key: "3fb6bb1bde447a8f832192a28124935e"
server_key_iv: "13fea745a04c5f0f2b574b7acfea80f5"
server_key_version: "encryptionkey@0"
I20260808 08:34:38.485505 14775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "907ffa45f10e485c82b483eeb696cc00"
format_stamp: "Formatted at 2026-08-08 08:34:38 on dist-test-slave-chsk"
server_key: "3fb6bb1bde447a8f832192a28124935e"
server_key_iv: "13fea745a04c5f0f2b574b7acfea80f5"
server_key_version: "encryptionkey@0"
I20260808 08:34:38.490775 14775 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:34:38.494267 14792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:38.495637 14775 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260808 08:34:38.495827 14775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "907ffa45f10e485c82b483eeb696cc00"
format_stamp: "Formatted at 2026-08-08 08:34:38 on dist-test-slave-chsk"
server_key: "3fb6bb1bde447a8f832192a28124935e"
server_key_iv: "13fea745a04c5f0f2b574b7acfea80f5"
server_key_version: "encryptionkey@0"
I20260808 08:34:38.496032 14775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:38.517396 14775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:38.522313 14775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:38.522636 14775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:38.541723 14775 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:38085
I20260808 08:34:38.541776 14846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:38085 every 8 connection(s)
I20260808 08:34:38.543202 14775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:38.547129 14847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:38.547438 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 14775
I20260808 08:34:38.547672 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:34:38.548509 5779 external_mini_cluster.cc:1428] Setting key 159c9131f46e50a5a90bb888ab0eb974
I20260808 08:34:38.561618 14847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00: Bootstrap starting.
Aug 08 08:34:38 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178077, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:34:38.565668 14847 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:38.566790 14847 log.cc:824] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:38.570211 14847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00: No bootstrap required, opened a new log
I20260808 08:34:38.574035 14851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:38.550754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48988 (local address 127.5.164.254:38085)
0808 08:34:38.551591 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:38.551602 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:38.551643 (+ 41us) server_negotiation.cc:407] Connection header received
0808 08:34:38.553637 (+ 1994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:38.553663 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:38.554060 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:38.554390 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:38.556369 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:38.557699 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:38.559605 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:38.560302 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:38.560448 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:38.565507 (+ 5059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:38.565515 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:38.565528 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:38.565577 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:38.569439 (+ 3862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:38.570164 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:38.570175 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:38.570185 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:38.570403 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:38.570801 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:38.570809 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:38.570817 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:38.571541 (+ 724us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:38.571838 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:38.572220 (+ 382us) server_negotiation.cc:299] Negotiation successful
0808 08:34:38.572677 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":383,"threads_started":1}
I20260808 08:34:38.579113 14847 raft_consensus.cc:348] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "907ffa45f10e485c82b483eeb696cc00" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38085 } }
I20260808 08:34:38.579515 14847 raft_consensus.cc:374] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:38.579653 14847 raft_consensus.cc:729] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907ffa45f10e485c82b483eeb696cc00, State: Initialized, Role: FOLLOWER
I20260808 08:34:38.580297 14847 consensus_queue.cc:260] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "907ffa45f10e485c82b483eeb696cc00" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38085 } }
I20260808 08:34:38.580543 14847 raft_consensus.cc:388] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:38.580701 14847 raft_consensus.cc:482] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:38.580878 14847 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:38.583093 14847 raft_consensus.cc:504] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "907ffa45f10e485c82b483eeb696cc00" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38085 } }
I20260808 08:34:38.583688 14847 leader_election.cc:302] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 907ffa45f10e485c82b483eeb696cc00; no voters:
I20260808 08:34:38.584280 14847 leader_election.cc:288] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:38.584532 14854 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:38.585318 14854 raft_consensus.cc:686] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 1 LEADER]: Becoming Leader. State: Replica: 907ffa45f10e485c82b483eeb696cc00, State: Running, Role: LEADER
I20260808 08:34:38.585965 14854 consensus_queue.cc:237] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "907ffa45f10e485c82b483eeb696cc00" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38085 } }
I20260808 08:34:38.586697 14847 sys_catalog.cc:564] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:38.593806 14856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 907ffa45f10e485c82b483eeb696cc00. Latest consensus state: current_term: 1 leader_uuid: "907ffa45f10e485c82b483eeb696cc00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "907ffa45f10e485c82b483eeb696cc00" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38085 } } }
I20260808 08:34:38.593740 14855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "907ffa45f10e485c82b483eeb696cc00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "907ffa45f10e485c82b483eeb696cc00" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38085 } } }
I20260808 08:34:38.594223 14856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:38.594249 14855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [sys.catalog]: This master's current role is: LEADER
W20260808 08:34:38.598472 14868 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:34:38.598587 14868 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:34:38.598739 14869 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:38.601101 14869 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:38.610114 14869 catalog_manager.cc:1347] Generated new cluster ID: db26e160b45242c6b87a98b864d63391
I20260808 08:34:38.610248 14869 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:38.620311 14869 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:38.621635 14869 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:38.631265 14869 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00: Generated new TSK 0
I20260808 08:34:38.632169 14869 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:34:38.706676 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:38085
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:39.057631 14875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:39.057940 14875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:39.058123 14875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:39.066011 14875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:39.066155 14875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:39.066350 14875 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:34:39.076651 14875 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:38085
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:39.078034 14875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:39.079484 14875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:39.093551 14881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:39.093582 14880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:39.093736 14883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:39.094525 14875 server_base.cc:1034] running on GCE node
I20260808 08:34:39.095253 14875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:39.096249 14875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:39.097460 14875 hybrid_clock.cc:648] HybridClock initialized: now 1786178079097409 us; error 39 us; skew 500 ppm
I20260808 08:34:39.097798 14875 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:39 dist-test-slave-chsk krb5kdc[14760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178079, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:39.101223 14875 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:34:39.102784 14875 webserver.cc:460] Webserver started at http://127.5.164.193:34137/ using document root <none> and password file <none>
I20260808 08:34:39.103588 14875 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:39.103749 14875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:39.104079 14875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:39.107087 14875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "e92ce657f204440987d57d9f26001fd5"
format_stamp: "Formatted at 2026-08-08 08:34:39 on dist-test-slave-chsk"
server_key: "609c063516e81234bf0004564f2b12e5"
server_key_iv: "6c0f4729065048546ba3dc6fa0dec1da"
server_key_version: "encryptionkey@0"
I20260808 08:34:39.108021 14875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "e92ce657f204440987d57d9f26001fd5"
format_stamp: "Formatted at 2026-08-08 08:34:39 on dist-test-slave-chsk"
server_key: "609c063516e81234bf0004564f2b12e5"
server_key_iv: "6c0f4729065048546ba3dc6fa0dec1da"
server_key_version: "encryptionkey@0"
I20260808 08:34:39.113293 14875 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260808 08:34:39.117074 14891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:39.118418 14875 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:34:39.118602 14875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "e92ce657f204440987d57d9f26001fd5"
format_stamp: "Formatted at 2026-08-08 08:34:39 on dist-test-slave-chsk"
server_key: "609c063516e81234bf0004564f2b12e5"
server_key_iv: "6c0f4729065048546ba3dc6fa0dec1da"
server_key_version: "encryptionkey@0"
I20260808 08:34:39.118841 14875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:39.138147 14875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:39.142422 14875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:39.142735 14875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:39.143811 14875 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:39.145182 14875 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:39.145292 14875 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:39.145442 14875 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:39.145517 14875 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:39.180464 14875 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:39151
I20260808 08:34:39.180514 15017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:39151 every 8 connection(s)
I20260808 08:34:39.181792 14875 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:34:39.186905 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 14875
I20260808 08:34:39.187119 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:34:39.187810 5779 external_mini_cluster.cc:1428] Setting key 4ab62c1f3cc2381e952a2e7c650138cf
Aug 08 08:34:39 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178079, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:34:39.202567 15020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:39.184435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:41277 (local address 127.5.164.254:38085)
0808 08:34:39.184937 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:39.184942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:39.185757 (+ 815us) server_negotiation.cc:407] Connection header received
0808 08:34:39.187866 (+ 2109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:39.187872 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:39.188005 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:39.188136 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:39.189918 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:39.190755 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:39.192379 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:39.192784 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:39.192923 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:39.196543 (+ 3620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:39.196548 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:39.196551 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:39.196583 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:39.199312 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:39.200157 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:39.200169 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:39.200172 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:39.200292 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:39.200751 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:39.200755 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:39.200757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:39.201023 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:39.201196 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:39.201933 (+ 737us) server_negotiation.cc:299] Negotiation successful
0808 08:34:39.202191 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":275,"threads_started":1}
I20260808 08:34:39.203624 15021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:39.184864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:41277)
0808 08:34:39.185577 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:39.185632 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:39.187583 (+ 1951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:39.188379 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:39.188387 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:39.189066 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:39.189752 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:39.189772 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:39.190916 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:39.190928 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:39.192224 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:39.192236 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:39.193022 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:39.193029 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:39.193265 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:39.194030 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:39.194065 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:39.196313 (+ 2248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:39.199451 (+ 3138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:39.199460 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:39.199475 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:39.200011 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:39.200408 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:39.200413 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:39.200417 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:39.200619 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:39.201166 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:39.201173 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:39.201537 (+ 364us) client_negotiation.cc:769] Sending connection context
0808 08:34:39.201820 (+ 283us) client_negotiation.cc:240] Negotiation successful
0808 08:34:39.202382 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":285,"threads_started":1}
I20260808 08:34:39.205274 15018 heartbeater.cc:347] Connected to a master server at 127.5.164.254:38085
I20260808 08:34:39.205578 15018 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:39.206326 15018 heartbeater.cc:511] Master 127.5.164.254:38085 requested a full tablet report, sending...
I20260808 08:34:39.208730 14811 ts_manager.cc:194] Registered new tserver with Master: e92ce657f204440987d57d9f26001fd5 (127.5.164.193:39151)
I20260808 08:34:39.210994 14811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:41277
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:34:39.252259 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:38085
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:39.599027 15024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:39.599476 15024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:39.599653 15024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:39.607436 15024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:39.607558 15024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:39.607758 15024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:34:39.618172 15024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:38085
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:39.619658 15024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:39.621059 15024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:39.636072 15030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:39.636279 15035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:39.636893 15029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:39.637777 15024 server_base.cc:1034] running on GCE node
I20260808 08:34:39.638465 15024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:39.639581 15024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:39.640875 15024 hybrid_clock.cc:648] HybridClock initialized: now 1786178079640831 us; error 41 us; skew 500 ppm
I20260808 08:34:39.641211 15024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:39 dist-test-slave-chsk krb5kdc[14760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178079, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:39.644773 15024 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:34:39.646538 15024 webserver.cc:460] Webserver started at http://127.5.164.194:45591/ using document root <none> and password file <none>
I20260808 08:34:39.647367 15024 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:39.647503 15024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:39.647835 15024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:39.650888 15024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "e5668c4170bc46328d4cdd6e4f121a17"
format_stamp: "Formatted at 2026-08-08 08:34:39 on dist-test-slave-chsk"
server_key: "66cd43a3a5cfccd3f00b906a277b4d5b"
server_key_iv: "5e95125bb6881460624feb2801e0054b"
server_key_version: "encryptionkey@0"
I20260808 08:34:39.651814 15024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "e5668c4170bc46328d4cdd6e4f121a17"
format_stamp: "Formatted at 2026-08-08 08:34:39 on dist-test-slave-chsk"
server_key: "66cd43a3a5cfccd3f00b906a277b4d5b"
server_key_iv: "5e95125bb6881460624feb2801e0054b"
server_key_version: "encryptionkey@0"
I20260808 08:34:39.657312 15024 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:34:39.661204 15042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:39.662776 15024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:34:39.662964 15024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "e5668c4170bc46328d4cdd6e4f121a17"
format_stamp: "Formatted at 2026-08-08 08:34:39 on dist-test-slave-chsk"
server_key: "66cd43a3a5cfccd3f00b906a277b4d5b"
server_key_iv: "5e95125bb6881460624feb2801e0054b"
server_key_version: "encryptionkey@0"
I20260808 08:34:39.663228 15024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:39.678762 15024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:39.683019 15024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:39.683363 15024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:39.684370 15024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:39.685787 15024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:39.685894 15024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:39.686045 15024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:39.686131 15024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:39.723989 15024 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:45049
I20260808 08:34:39.724030 15168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:45049 every 8 connection(s)
I20260808 08:34:39.725361 15024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:34:39.731962 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 15024
I20260808 08:34:39.732179 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:34:39.732841 5779 external_mini_cluster.cc:1428] Setting key 4ce769898fe5e6f9da21ba400d516771
Aug 08 08:34:39 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178079, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:34:39.758633 15171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:39.728117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:34635 (local address 127.5.164.254:38085)
0808 08:34:39.730825 (+ 2708us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:39.730832 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:39.734350 (+ 3518us) server_negotiation.cc:407] Connection header received
0808 08:34:39.737471 (+ 3121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:39.737480 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:39.737587 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:39.737697 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:39.740406 (+ 2709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:39.741567 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:39.743887 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:39.744627 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:39.744780 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:39.750263 (+ 5483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:39.750271 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:39.750277 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:39.750327 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:39.754260 (+ 3933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:39.755378 (+ 1118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:39.755390 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:39.755393 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:39.755580 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:39.756205 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:39.756213 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:39.756219 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:39.756664 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:39.756813 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:39.758006 (+ 1193us) server_negotiation.cc:299] Negotiation successful
0808 08:34:39.758256 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2495,"thread_start_us":1795,"threads_started":1}
I20260808 08:34:39.760035 15172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:39.728908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:34635)
0808 08:34:39.734136 (+ 5228us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:39.734219 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:39.737075 (+ 2856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:39.738283 (+ 1208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:39.738300 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:39.739231 (+ 931us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:39.740147 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:39.740175 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:39.741784 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:39.741790 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:39.743718 (+ 1928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:39.743736 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:39.745112 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:39.745123 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:39.745478 (+ 355us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:39.746419 (+ 941us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:39.746456 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:39.749885 (+ 3429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:39.754511 (+ 4626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:39.754522 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:39.754542 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:39.755187 (+ 645us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:39.755731 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:39.755738 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:39.755743 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:39.756004 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:39.756916 (+ 912us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:39.756928 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:39.757494 (+ 566us) client_negotiation.cc:769] Sending connection context
0808 08:34:39.757888 (+ 394us) client_negotiation.cc:240] Negotiation successful
0808 08:34:39.758486 (+ 598us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4812,"thread_start_us":4506,"threads_started":1}
I20260808 08:34:39.762190 15169 heartbeater.cc:347] Connected to a master server at 127.5.164.254:38085
I20260808 08:34:39.762486 15169 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:39.763525 15169 heartbeater.cc:511] Master 127.5.164.254:38085 requested a full tablet report, sending...
I20260808 08:34:39.765477 14811 ts_manager.cc:194] Registered new tserver with Master: e5668c4170bc46328d4cdd6e4f121a17 (127.5.164.194:45049)
I20260808 08:34:39.766845 14811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:34635
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:34:39.806178 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:38085
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:40.151676 15175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:40.151964 15175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:40.152057 15175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:40.159228 15175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:40.159380 15175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:40.159576 15175 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:34:40.169641 15175 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:38085
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:40.170961 15175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:40.172322 15175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:40.185786 15180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:40.185753 15182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:40.186048 15184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:40.186877 15175 server_base.cc:1034] running on GCE node
I20260808 08:34:40.187573 15175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:40.188606 15175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:40.189810 15175 hybrid_clock.cc:648] HybridClock initialized: now 1786178080189769 us; error 37 us; skew 500 ppm
I20260808 08:34:40.190188 15175 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:40 dist-test-slave-chsk krb5kdc[14760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178080, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:40.193574 15175 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:34:40.195191 15175 webserver.cc:460] Webserver started at http://127.5.164.195:34705/ using document root <none> and password file <none>
I20260808 08:34:40.195904 15175 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:40.196040 15175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:40.196427 15175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:40.199523 15175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "7ab3e0568c184e00b89da49036314614"
format_stamp: "Formatted at 2026-08-08 08:34:40 on dist-test-slave-chsk"
server_key: "9261e9c45e22e1723cd5d49758c71deb"
server_key_iv: "b0e4183f420b952f40defbe927a5c331"
server_key_version: "encryptionkey@0"
I20260808 08:34:40.200456 15175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "7ab3e0568c184e00b89da49036314614"
format_stamp: "Formatted at 2026-08-08 08:34:40 on dist-test-slave-chsk"
server_key: "9261e9c45e22e1723cd5d49758c71deb"
server_key_iv: "b0e4183f420b952f40defbe927a5c331"
server_key_version: "encryptionkey@0"
I20260808 08:34:40.205808 15175 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:34:40.209224 15191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:40.210587 15175 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:34:40.210791 15175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "7ab3e0568c184e00b89da49036314614"
format_stamp: "Formatted at 2026-08-08 08:34:40 on dist-test-slave-chsk"
server_key: "9261e9c45e22e1723cd5d49758c71deb"
server_key_iv: "b0e4183f420b952f40defbe927a5c331"
server_key_version: "encryptionkey@0"
I20260808 08:34:40.211001 15175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:40.214087 15018 heartbeater.cc:503] Master 127.5.164.254:38085 was elected leader, sending a full tablet report...
I20260808 08:34:40.224532 15175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:40.229162 15175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:40.229483 15175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:40.230620 15175 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:40.232091 15175 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:40.232173 15175 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:40.232335 15175 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:40.232388 15175 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:40.266008 15175 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:39241
I20260808 08:34:40.266048 15311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:39241 every 8 connection(s)
I20260808 08:34:40.267493 15175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:34:40.275753 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 15175
I20260808 08:34:40.275936 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:34:40.276393 5779 external_mini_cluster.cc:1428] Setting key b84bc3ee7408cb5816fffebd72ed37c1
Aug 08 08:34:40 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178080, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:34:40.288478 15314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:40.270241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:60295 (local address 127.5.164.254:38085)
0808 08:34:40.270752 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:40.270757 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:40.271788 (+ 1031us) server_negotiation.cc:407] Connection header received
0808 08:34:40.273644 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:40.273650 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:40.273743 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:40.273866 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:40.275560 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:40.276556 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:40.278574 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:40.278997 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:40.279136 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:40.282652 (+ 3516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:40.282657 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:40.282660 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:40.282692 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:40.285201 (+ 2509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:40.285940 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:40.285944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:40.285947 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:40.286069 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:40.286516 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:40.286526 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:40.286528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:40.286803 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:40.286978 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:40.287826 (+ 848us) server_negotiation.cc:299] Negotiation successful
0808 08:34:40.288059 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":247,"threads_started":1}
I20260808 08:34:40.289543 15315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:40.270847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:60295)
0808 08:34:40.271610 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:40.271649 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:40.273352 (+ 1703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:40.274124 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:40.274133 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:40.274652 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:40.275341 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:40.275366 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:40.276726 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:40.276732 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:40.278417 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:40.278430 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:40.279287 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:40.279296 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:40.279516 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:40.280246 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:40.280268 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:40.282427 (+ 2159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:40.285350 (+ 2923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:40.285358 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:40.285375 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:40.285799 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:40.286183 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:34:40.286188 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:34:40.286192 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:34:40.286386 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:34:40.286941 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:40.286948 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:40.287432 (+ 484us) client_negotiation.cc:769] Sending connection context
0808 08:34:40.287704 (+ 272us) client_negotiation.cc:240] Negotiation successful
0808 08:34:40.288243 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":335,"threads_started":1}
I20260808 08:34:40.291530 15312 heartbeater.cc:347] Connected to a master server at 127.5.164.254:38085
I20260808 08:34:40.291972 15312 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:40.292960 15312 heartbeater.cc:511] Master 127.5.164.254:38085 requested a full tablet report, sending...
I20260808 08:34:40.294476 14810 ts_manager.cc:194] Registered new tserver with Master: 7ab3e0568c184e00b89da49036314614 (127.5.164.195:39241)
I20260808 08:34:40.295469 14810 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:60295
I20260808 08:34:40.304718 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.193.keytab.
Entry for principal oryx/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.193.keytab.
WARNING: no policy specified for oryx/127.5.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.194.keytab.
Entry for principal oryx/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.194.keytab.
WARNING: no policy specified for oryx/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.195.keytab.
Entry for principal oryx/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.195.keytab.
I20260808 08:34:40.485700 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 14875
Aug 08 08:34:40 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178077, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:34:40.503050 15323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:40.486934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34986 (local address 127.5.164.193:39151)
0808 08:34:40.487697 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:40.487705 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:40.487734 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:34:40.487798 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:40.487804 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:40.488134 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:40.488277 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:40.489680 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:40.490775 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:40.492155 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:40.492744 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:40.492845 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:40.496969 (+ 4124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:40.496981 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:40.496995 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:40.497034 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:40.500205 (+ 3171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:40.500976 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:40.500983 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:40.500985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:40.501131 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:40.501505 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:40.501508 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:40.501510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:40.501847 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:40.502092 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:40.502399 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 08:34:40.502721 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":420,"threads_started":1}
I20260808 08:34:40.504410 15013 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:40.590880 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 14875
I20260808 08:34:40.610749 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 15024
Aug 08 08:34:40 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178077, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:34:40.627944 15325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:40.611818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57254 (local address 127.5.164.194:45049)
0808 08:34:40.612330 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:40.612337 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:40.612361 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:34:40.612429 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:40.612436 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:40.612636 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:40.612776 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:40.614034 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:40.615216 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:40.616583 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:40.617139 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:40.617244 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:40.621889 (+ 4645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:40.621904 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:40.621920 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:40.621961 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:40.625276 (+ 3315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:40.626006 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:40.626014 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:40.626016 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:40.626155 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:40.626484 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:40.626487 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:40.626489 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:40.626855 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:40.627089 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:40.627413 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 08:34:40.627628 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":261,"threads_started":1}
I20260808 08:34:40.629627 15164 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:40.713622 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 15024
I20260808 08:34:40.733258 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 15175
Aug 08 08:34:40 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178077, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:34:40.752585 15327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:40.734425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43220 (local address 127.5.164.195:39241)
0808 08:34:40.735001 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:40.735008 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:40.735042 (+ 34us) server_negotiation.cc:407] Connection header received
0808 08:34:40.735102 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:40.735110 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:40.735444 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:40.735580 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:40.737152 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:40.738164 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:40.739805 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:40.740514 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:40.740631 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:40.745575 (+ 4944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:40.745590 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:40.745607 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:40.745646 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:40.748587 (+ 2941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:40.749444 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:40.749452 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:40.749455 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:40.749598 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:40.750021 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:40.750030 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:40.750034 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:40.750580 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:40.750908 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:40.751690 (+ 782us) server_negotiation.cc:299] Negotiation successful
0808 08:34:40.752007 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":296,"threads_started":1}
I20260808 08:34:40.754462 15307 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:40.843484 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 15175
I20260808 08:34:40.861757 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 14775
I20260808 08:34:40.863070 14842 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:40.969640 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 14775
I20260808 08:34:40.996171 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:38085
--webserver_interface=127.5.164.254
--webserver_port=35481
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:38085
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:34:41.344260 15331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:41.344657 15331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:41.344821 15331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:41.352346 15331 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:41.352521 15331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:41.352632 15331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:41.352738 15331 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:41.352823 15331 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:41.363113 15331 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:38085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:38085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=35481
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:41.364609 15331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:41.366019 15331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:41.378175 15341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:41.378306 15337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:41.378448 15338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:41.379202 15331 server_base.cc:1034] running on GCE node
I20260808 08:34:41.379997 15331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:41.381390 15331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:41.382620 15331 hybrid_clock.cc:648] HybridClock initialized: now 1786178081382580 us; error 50 us; skew 500 ppm
I20260808 08:34:41.382979 15331 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:41 dist-test-slave-chsk krb5kdc[14760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178081, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:41.386173 15331 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:34:41.387792 15331 webserver.cc:460] Webserver started at http://127.5.164.254:35481/ using document root <none> and password file <none>
I20260808 08:34:41.388509 15331 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:41.388672 15331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:41.394155 15331 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:34:41.397023 15350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:41.398341 15331 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:34:41.398527 15331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "907ffa45f10e485c82b483eeb696cc00"
format_stamp: "Formatted at 2026-08-08 08:34:38 on dist-test-slave-chsk"
server_key: "3fb6bb1bde447a8f832192a28124935e"
server_key_iv: "13fea745a04c5f0f2b574b7acfea80f5"
server_key_version: "encryptionkey@0"
I20260808 08:34:41.399577 15331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:41.419584 15331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:41.424201 15331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:41.424504 15331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:41.444394 15331 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:38085
I20260808 08:34:41.444490 15401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:38085 every 8 connection(s)
I20260808 08:34:41.446079 15331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:41.453368 15403 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:34:41.455194 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 15331
I20260808 08:34:41.456228 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:39151
--local_ip_for_outbound_sockets=127.5.164.193
--tserver_master_addrs=127.5.164.254:38085
--webserver_port=34137
--webserver_interface=127.5.164.193
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.5.164.193
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:34:41.458077 15403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00: Bootstrap starting.
I20260808 08:34:41.480954 15403 log.cc:824] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:41.490588 15403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:34:41.491225 15403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00: Bootstrap complete.
I20260808 08:34:41.500741 15403 raft_consensus.cc:348] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "907ffa45f10e485c82b483eeb696cc00" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38085 } }
I20260808 08:34:41.501652 15403 raft_consensus.cc:729] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907ffa45f10e485c82b483eeb696cc00, State: Initialized, Role: FOLLOWER
I20260808 08:34:41.502331 15403 consensus_queue.cc:260] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "907ffa45f10e485c82b483eeb696cc00" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38085 } }
I20260808 08:34:41.502576 15403 raft_consensus.cc:388] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:41.502714 15403 raft_consensus.cc:482] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:41.502929 15403 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:34:41.507086 15403 raft_consensus.cc:504] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "907ffa45f10e485c82b483eeb696cc00" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38085 } }
I20260808 08:34:41.507709 15403 leader_election.cc:302] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 907ffa45f10e485c82b483eeb696cc00; no voters:
I20260808 08:34:41.508376 15403 leader_election.cc:288] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 08:34:41.508677 15407 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:34:41.509742 15407 raft_consensus.cc:686] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [term 2 LEADER]: Becoming Leader. State: Replica: 907ffa45f10e485c82b483eeb696cc00, State: Running, Role: LEADER
I20260808 08:34:41.510386 15407 consensus_queue.cc:237] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "907ffa45f10e485c82b483eeb696cc00" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38085 } }
I20260808 08:34:41.510820 15403 sys_catalog.cc:564] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:41.513123 15408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "907ffa45f10e485c82b483eeb696cc00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "907ffa45f10e485c82b483eeb696cc00" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38085 } } }
I20260808 08:34:41.513600 15408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:41.515899 15409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 907ffa45f10e485c82b483eeb696cc00. Latest consensus state: current_term: 2 leader_uuid: "907ffa45f10e485c82b483eeb696cc00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "907ffa45f10e485c82b483eeb696cc00" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38085 } } }
I20260808 08:34:41.516373 15409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:41.518419 15413 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:41.525013 15413 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:41.526659 15413 catalog_manager.cc:1259] Loaded cluster ID: db26e160b45242c6b87a98b864d63391
I20260808 08:34:41.526837 15413 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:41.531045 15413 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:41.532696 15413 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 907ffa45f10e485c82b483eeb696cc00: Loaded TSK: 0
I20260808 08:34:41.534304 15413 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:34:41.815316 15405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:41.815613 15405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:41.815760 15405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:41.823654 15405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:41.823776 15405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:41.823936 15405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:34:41.834084 15405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.193.keytab
--principal=oryx/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:39151
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=34137
--tserver_master_addrs=127.5.164.254:38085
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:41.835562 15405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:41.836911 15405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:41.850143 15430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:41.850307 15432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:41.850307 15434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:41.852362 15405 server_base.cc:1034] running on GCE node
I20260808 08:34:41.853140 15405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:41.854249 15405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:41.855473 15405 hybrid_clock.cc:648] HybridClock initialized: now 1786178081855429 us; error 40 us; skew 500 ppm
I20260808 08:34:41.855823 15405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:41 dist-test-slave-chsk krb5kdc[14760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178081, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:41.859133 15405 init.cc:377] Logged in from keytab as oryx/127.5.164.193@KRBTEST.COM (short username oryx)
I20260808 08:34:41.860898 15405 webserver.cc:460] Webserver started at http://127.5.164.193:34137/ using document root <none> and password file <none>
I20260808 08:34:41.861646 15405 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:41.861804 15405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:41.867559 15405 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:34:41.870433 15441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:41.871881 15405 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:41.872051 15405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "e92ce657f204440987d57d9f26001fd5"
format_stamp: "Formatted at 2026-08-08 08:34:39 on dist-test-slave-chsk"
server_key: "609c063516e81234bf0004564f2b12e5"
server_key_iv: "6c0f4729065048546ba3dc6fa0dec1da"
server_key_version: "encryptionkey@0"
I20260808 08:34:41.873025 15405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:41.891363 15405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:41.895895 15405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:41.896198 15405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:41.897398 15405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:41.898792 15405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:41.898886 15405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:41.898964 15405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:41.899019 15405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:41.933715 15405 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:39151
I20260808 08:34:41.933785 15560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:39151 every 8 connection(s)
I20260808 08:34:41.935276 15405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:34:41.937463 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 15405
I20260808 08:34:41.938230 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:45049
--local_ip_for_outbound_sockets=127.5.164.194
--tserver_master_addrs=127.5.164.254:38085
--webserver_port=45591
--webserver_interface=127.5.164.194
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.5.164.194
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:34:41 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:41 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:34:42.282650 15565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:42.282956 15565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:42.283113 15565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:42.290553 15565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:42.290676 15565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:42.290874 15565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:34:42.301728 15565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.194.keytab
--principal=oryx/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:45049
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=45591
--tserver_master_addrs=127.5.164.254:38085
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:42.303382 15565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:42.304924 15565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:42.325042 15574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:42.325032 15572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:42.325837 15571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:42.326442 15565 server_base.cc:1034] running on GCE node
I20260808 08:34:42.327725 15565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:42.329608 15565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:42.330958 15565 hybrid_clock.cc:648] HybridClock initialized: now 1786178082330867 us; error 61 us; skew 500 ppm
I20260808 08:34:42.331595 15565 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:42 dist-test-slave-chsk krb5kdc[14760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178082, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:42.337847 15565 init.cc:377] Logged in from keytab as oryx/127.5.164.194@KRBTEST.COM (short username oryx)
I20260808 08:34:42.340672 15565 webserver.cc:460] Webserver started at http://127.5.164.194:45591/ using document root <none> and password file <none>
I20260808 08:34:42.342163 15565 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:42.342428 15565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:42.353735 15565 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.002s sys 0.007s
I20260808 08:34:42.358814 15582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:42.361377 15565 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260808 08:34:42.361694 15565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "e5668c4170bc46328d4cdd6e4f121a17"
format_stamp: "Formatted at 2026-08-08 08:34:39 on dist-test-slave-chsk"
server_key: "66cd43a3a5cfccd3f00b906a277b4d5b"
server_key_iv: "5e95125bb6881460624feb2801e0054b"
server_key_version: "encryptionkey@0"
I20260808 08:34:42.363934 15565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:42.385166 15565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:42.390035 15565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:42.390343 15565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:42.391530 15565 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:42.393188 15565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:42.393316 15565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:42.393460 15565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:42.393546 15565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:42.436517 15565 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:45049
I20260808 08:34:42.436564 15705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:45049 every 8 connection(s)
I20260808 08:34:42.438184 15565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:34:42.440357 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 15565
I20260808 08:34:42.441497 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:39241
--local_ip_for_outbound_sockets=127.5.164.195
--tserver_master_addrs=127.5.164.254:38085
--webserver_port=34705
--webserver_interface=127.5.164.195
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.5.164.195
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:34:42 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:42 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:34:43.145020 15710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:43.145306 15710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:43.145464 15710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:43.153764 15710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:43.153934 15710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:43.154192 15710 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:34:43.170881 15710 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/krb5kdc/oryx_127.5.164.195.keytab
--principal=oryx/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:39241
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=34705
--tserver_master_addrs=127.5.164.254:38085
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:43.172842 15710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:43.174606 15710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:43.190137 15716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:43.190337 15719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:43.190670 15717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:43.192744 15710 server_base.cc:1034] running on GCE node
I20260808 08:34:43.193476 15710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:43.194684 15710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:43.198060 15710 hybrid_clock.cc:648] HybridClock initialized: now 1786178083197940 us; error 109 us; skew 500 ppm
I20260808 08:34:43.198442 15710 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:34:43 dist-test-slave-chsk krb5kdc[14760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178083, etypes {rep=17 tkt=17 ses=17}, oryx/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:34:43.202652 15710 init.cc:377] Logged in from keytab as oryx/127.5.164.195@KRBTEST.COM (short username oryx)
I20260808 08:34:43.204768 15710 webserver.cc:460] Webserver started at http://127.5.164.195:34705/ using document root <none> and password file <none>
I20260808 08:34:43.205569 15710 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:43.205744 15710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:43.211658 15710 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 08:34:43.214538 15726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:43.216024 15710 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:43.216199 15710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "7ab3e0568c184e00b89da49036314614"
format_stamp: "Formatted at 2026-08-08 08:34:40 on dist-test-slave-chsk"
server_key: "9261e9c45e22e1723cd5d49758c71deb"
server_key_iv: "b0e4183f420b952f40defbe927a5c331"
server_key_version: "encryptionkey@0"
I20260808 08:34:43.217160 15710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:43.234282 15710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:43.239056 15710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:43.239375 15710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:43.240549 15710 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:43.242101 15710 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:43.242192 15710 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:43.242338 15710 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:43.242417 15710 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:43.309613 15710 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:39241
I20260808 08:34:43.309628 15851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:39241 every 8 connection(s)
I20260808 08:34:43.312666 15710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:34:43.322464 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 15710
Aug 08 08:34:43 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:43 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:43.363283 15858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:43.330524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48996 (local address 127.5.164.254:38085)
0808 08:34:43.331172 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:43.331178 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:43.343804 (+ 12626us) server_negotiation.cc:407] Connection header received
0808 08:34:43.343979 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:43.343983 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:43.344061 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:43.344195 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:43.346252 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.347120 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.350058 (+ 2938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.350504 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.350667 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:43.354307 (+ 3640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:43.354316 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:43.354334 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:43.354374 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:43.357522 (+ 3148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:43.358418 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:43.358447 (+ 29us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:43.358455 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:43.358669 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:34:43.359136 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:34:43.359144 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:34:43.359149 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:34:43.359959 (+ 810us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:43.360323 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:43.361866 (+ 1543us) server_negotiation.cc:299] Negotiation successful
0808 08:34:43.362329 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":276,"threads_started":1}
W20260808 08:34:43.426811 15564 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.473s user 0.006s sys 0.009s
W20260808 08:34:43.429184 15563 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:41.938680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:43575 (local address 127.5.164.254:38085)
0808 08:34:41.939510 (+ 830us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:41.939529 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:41.944026 (+ 4497us) server_negotiation.cc:407] Connection header received
0808 08:34:41.946270 (+ 2244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:41.946292 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:41.946749 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:41.947177 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:41.948606 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:41.949908 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:41.951610 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:41.952813 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:41.953050 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:43.428693 (+1475643us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:43575: BlockingRecv error: recv got EOF from 127.5.164.193:43575 (error 108)
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":299,"threads_started":1}
I20260808 08:34:43.430455 15564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:41.938667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:43575)
0808 08:34:41.943800 (+ 5133us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:41.943858 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:41.945641 (+ 1783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:41.947304 (+ 1663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:41.947312 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:41.947855 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:41.948387 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:41.948404 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:41.950104 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:41.950113 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:41.951460 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:41.951472 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:41.953042 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:41.953047 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:41.953236 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:41.953948 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:41.953972 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:43.428201 (+1474229us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":4812,"thread_start_us":4593,"threads_started":1}
W20260808 08:34:43.431728 15561 heartbeater.cc:644] Failed to heartbeat to 127.5.164.254:38085 (0 consecutive failures): Not authorized: Failed to ping master at 127.5.164.254:38085: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Aug 08 08:34:43 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:43 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:34:43.451929 15563 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:43.434161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:42619 (local address 127.5.164.254:38085)
0808 08:34:43.434417 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:43.434428 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:43.434764 (+ 336us) server_negotiation.cc:407] Connection header received
0808 08:34:43.435170 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:43.435180 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:43.435348 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:43.435501 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:43.437155 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.439021 (+ 1866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.442024 (+ 3003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.442997 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.443130 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:43.451667 (+ 8537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:42619: BlockingRecv error: recv got EOF from 127.5.164.193:42619 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 08:34:43.452446 15564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:43.433561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:42619)
0808 08:34:43.434639 (+ 1078us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:43.434668 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:43.434911 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:43.435823 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:43.435833 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:43.436552 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:43.436895 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:43.436914 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.439361 (+ 2447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.439369 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:43.441760 (+ 2391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:43.441781 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.443615 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.443635 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:43.443828 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:43.444615 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:43.444654 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:43.452156 (+ 7502us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":903}
Aug 08 08:34:43 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:43 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:43.482987 15564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:43.456061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:35349)
0808 08:34:43.457038 (+ 977us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:43.457067 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:43.457333 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:43.460445 (+ 3112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:43.460454 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:43.461370 (+ 916us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:43.461721 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:43.461741 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.469940 (+ 8199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.469950 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:43.472481 (+ 2531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:43.472507 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.474226 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.474237 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:43.474572 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:43.475684 (+ 1112us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:43.475722 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:43.482506 (+ 6784us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":805}
W20260808 08:34:43.483387 15563 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:43.456582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:35349 (local address 127.5.164.254:38085)
0808 08:34:43.456830 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:43.456839 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:43.457182 (+ 343us) server_negotiation.cc:407] Connection header received
0808 08:34:43.457534 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:43.457543 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:43.457656 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:43.457761 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:43.462031 (+ 4270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.463834 (+ 1803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.472844 (+ 9010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.473991 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.474203 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:43.482921 (+ 8718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:35349: BlockingRecv error: recv got EOF from 127.5.164.193:35349 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260808 08:34:43.484197 15561 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:34:43.638092 15709 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.168s user 0.000s sys 0.015s
I20260808 08:34:43.639868 15709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:42.442260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:46833)
0808 08:34:42.457407 (+ 15147us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:42.457661 (+ 254us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:42.460465 (+ 2804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:42.461773 (+ 1308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:42.461786 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:42.462613 (+ 827us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:42.463445 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:42.463472 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:42.465189 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:42.465195 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:42.467272 (+ 2077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:42.467289 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:42.468739 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:42.468747 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:42.469072 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:42.470092 (+ 1020us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:42.470124 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:43.638892 (+1168768us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":14723,"thread_start_us":14800,"threads_started":1}
W20260808 08:34:43.640014 15708 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:42.441476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:46833 (local address 127.5.164.254:38085)
0808 08:34:42.456726 (+ 15250us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:42.456735 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:42.458391 (+ 1656us) server_negotiation.cc:407] Connection header received
0808 08:34:42.460852 (+ 2461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:42.460858 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:42.460977 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:42.461074 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:42.463702 (+ 2628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:42.464951 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:42.467457 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:42.468214 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:42.468315 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:43.639440 (+1171125us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:46833: BlockingRecv error: recv got EOF from 127.5.164.194:46833 (error 108)
Metrics: {"server-negotiator.queue_time_us":15054,"thread_start_us":15997,"threads_started":1}
W20260808 08:34:43.641039 15706 heartbeater.cc:644] Failed to heartbeat to 127.5.164.254:38085 (0 consecutive failures): Not authorized: Failed to ping master at 127.5.164.254:38085: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Aug 08 08:34:43 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:43 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:43.658550 15709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:43.641886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:45507)
0808 08:34:43.642287 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:43.642316 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:43.642503 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:43.642896 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:43.642901 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:43.643367 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:43.643572 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:43.643584 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.645791 (+ 2207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.645795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:43.646781 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:43.646793 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.648141 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.648145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:43.648266 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:43.653932 (+ 5666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:43.653953 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:43.658316 (+ 4363us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220}
W20260808 08:34:43.659099 15708 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:43.641872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:45507 (local address 127.5.164.254:38085)
0808 08:34:43.642109 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:43.642115 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:43.642420 (+ 305us) server_negotiation.cc:407] Connection header received
0808 08:34:43.642649 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:43.642657 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:43.642746 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:43.642860 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:43.643782 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.645602 (+ 1820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.646935 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.647941 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.648126 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:43.658703 (+ 10577us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:45507: BlockingRecv error: recv got EOF from 127.5.164.194:45507 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
Aug 08 08:34:43 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:43 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:43.672874 15709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:43.659297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:34421)
0808 08:34:43.659829 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:43.659859 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:43.660036 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:43.660480 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:43.660489 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:43.661123 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:43.661457 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:43.661475 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.662596 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.662605 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:43.665033 (+ 2428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:43.665056 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.665873 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.665883 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:43.666213 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:43.667040 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:43.667077 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:43.672400 (+ 5323us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":310}
W20260808 08:34:43.672958 15708 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:43.659553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:34421 (local address 127.5.164.254:38085)
0808 08:34:43.659728 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:43.659734 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:43.659950 (+ 216us) server_negotiation.cc:407] Connection header received
0808 08:34:43.660202 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:43.660207 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:43.660297 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:43.660387 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:43.661646 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.662422 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.665223 (+ 2801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.665659 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.665757 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:43.672743 (+ 6986us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:34421: BlockingRecv error: recv got EOF from 127.5.164.194:34421 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 08:34:43.673440 15706 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:34:44.465325 15855 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.125s user 0.002s sys 0.023s
W20260808 08:34:44.466500 15854 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:43.316246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:37815 (local address 127.5.164.254:38085)
0808 08:34:43.330503 (+ 14257us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:43.330510 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:43.330526 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:34:43.330582 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:43.330586 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:43.330650 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:43.330796 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:43.332767 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.333556 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.337155 (+ 3599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.338156 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.338331 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:44.466294 (+1127963us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.195:37815: BlockingRecv error: recv got EOF from 127.5.164.195:37815 (error 108)
Metrics: {"server-negotiator.queue_time_us":14139,"thread_start_us":14040,"threads_started":1}
I20260808 08:34:44.467077 15855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:43.317311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:37815)
0808 08:34:43.327840 (+ 10529us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:43.327912 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:43.329844 (+ 1932us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:43.331272 (+ 1428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:43.331282 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:43.331833 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:43.332442 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:43.332459 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.333725 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.333734 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:43.336885 (+ 3151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:43.336910 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:43.338800 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:43.338810 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:43.339285 (+ 475us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:43.340539 (+ 1254us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:43.340586 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:44.466106 (+1125520us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":10172,"thread_start_us":9874,"threads_started":1}
W20260808 08:34:44.468009 15852 heartbeater.cc:644] Failed to heartbeat to 127.5.164.254:38085 (0 consecutive failures): Not authorized: Failed to ping master at 127.5.164.254:38085: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Aug 08 08:34:44 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:44 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:44.477782 15855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:44.468643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:35383)
0808 08:34:44.468836 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:44.468856 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:44.468973 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:44.469377 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:44.469381 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:44.469744 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:44.469907 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:44.469917 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:44.470940 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:44.470943 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:44.471989 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:44.472001 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:44.472866 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:44.472871 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:44.472997 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:44.473635 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:44.473652 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:44.477545 (+ 3893us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 08:34:44.477975 15854 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:44.468822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:35383 (local address 127.5.164.254:38085)
0808 08:34:44.468989 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:44.468995 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:44.469014 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:34:44.469063 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:44.469066 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:44.469127 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:44.469205 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:44.470046 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:44.470815 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:44.472134 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:44.472676 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:44.472781 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:44.477766 (+ 4985us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.195:35383: BlockingRecv error: recv got EOF from 127.5.164.195:35383 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 08:34:44 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:44 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:44.487555 15855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:44.478473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:54095)
0808 08:34:44.478630 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:44.478645 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:44.478751 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:44.479131 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:44.479136 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:44.479484 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:44.479636 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:44.479644 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:44.480685 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:44.480696 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:44.481654 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:44.481665 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:44.482395 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:44.482401 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:44.482575 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:44.483093 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:44.483109 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:44.487202 (+ 4093us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 08:34:44.487691 15854 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:44.478610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:54095 (local address 127.5.164.254:38085)
0808 08:34:44.478878 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:44.478888 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:44.478902 (+ 14us) server_negotiation.cc:407] Connection header received
0808 08:34:44.478939 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:44.478942 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:44.478996 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:44.479095 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:44.479784 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:44.480539 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:44.481809 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:44.482249 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:44.482383 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:44.487383 (+ 5000us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.195:54095: BlockingRecv error: recv got EOF from 127.5.164.195:54095 (error 108)
Metrics: {"server-negotiator.queue_time_us":147}
W20260808 08:34:44.487900 15852 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 08:34:44 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:44 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:44.495091 15860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:44.484792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:37499)
0808 08:34:44.485664 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:44.485687 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:44.485827 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:44.486223 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:44.486240 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:44.486798 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:44.486988 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:44.486998 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:44.489034 (+ 2036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:44.489039 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:44.490013 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:44.490024 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:44.490743 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:44.490749 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:44.490944 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:44.491523 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:44.491540 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:44.494831 (+ 3291us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":741,"thread_start_us":631,"threads_started":1}
W20260808 08:34:44.495345 15861 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:44.484881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:37499 (local address 127.5.164.254:38085)
0808 08:34:44.485516 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:44.485522 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:44.485769 (+ 247us) server_negotiation.cc:407] Connection header received
0808 08:34:44.485973 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:44.485978 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:44.486054 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:44.486156 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:44.487884 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:44.488898 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:44.490152 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:44.490562 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:44.490692 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:44.495034 (+ 4342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:37499: BlockingRecv error: recv got EOF from 127.5.164.193:37499 (error 108)
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":328,"threads_started":1}
Aug 08 08:34:44 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:44 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:44.683454 15862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:44.673968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:33849)
0808 08:34:44.674523 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:44.674540 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:44.674657 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:44.674950 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:44.674953 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:44.675433 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:44.675584 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:44.675593 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:44.676616 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:44.676619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:44.677681 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:44.677694 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:44.678433 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:44.678437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:44.678554 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:44.679210 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:44.679236 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:44.683202 (+ 3966us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":333,"threads_started":1}
W20260808 08:34:44.683590 15861 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:44.674054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:33849 (local address 127.5.164.254:38085)
0808 08:34:44.674305 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:44.674315 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:44.674620 (+ 305us) server_negotiation.cc:407] Connection header received
0808 08:34:44.674756 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:44.674760 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:44.674825 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:44.674908 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:44.675706 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:44.676488 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:44.677818 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:44.678276 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:44.678373 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:44.683390 (+ 5017us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:33849: BlockingRecv error: recv got EOF from 127.5.164.194:33849 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 08 08:34:45 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:45 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:45.499055 15863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:45.488504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:59195)
0808 08:34:45.489188 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:45.489211 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:45.489330 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:45.489660 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:45.489663 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:45.490107 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:45.490255 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:45.490263 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:45.491569 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:45.491578 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:45.492935 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:45.492948 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:45.493670 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:45.493674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:45.493790 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:45.494490 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:45.494509 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:45.498685 (+ 4176us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":394,"threads_started":1}
W20260808 08:34:45.499208 15864 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:45.488659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:59195 (local address 127.5.164.254:38085)
0808 08:34:45.489210 (+ 551us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:45.489215 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:45.489286 (+ 71us) server_negotiation.cc:407] Connection header received
0808 08:34:45.489431 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:45.489435 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:45.489516 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:45.489612 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:45.490383 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:45.491403 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:45.493065 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:45.493508 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:45.493606 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:45.498908 (+ 5302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.195:59195: BlockingRecv error: recv got EOF from 127.5.164.195:59195 (error 108)
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":297,"threads_started":1}
Aug 08 08:34:45 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:45 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:45.505854 15865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:45.496152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:55399)
0808 08:34:45.496734 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:45.496759 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:45.496893 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:45.497333 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:45.497339 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:45.497746 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:45.497986 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:45.498001 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:45.499042 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:45.499049 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:45.500212 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:45.500225 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:45.500959 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:45.500965 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:45.501175 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:45.501721 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:45.501740 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:45.505591 (+ 3851us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":326,"threads_started":1}
W20260808 08:34:45.506184 15866 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:45.496211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:55399 (local address 127.5.164.254:38085)
0808 08:34:45.497047 (+ 836us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:45.497052 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:45.497067 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:34:45.497106 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:45.497109 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:45.497177 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:45.497289 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:45.498133 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:45.498896 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:45.500357 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:45.500799 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:45.500935 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:45.505840 (+ 4905us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:55399: BlockingRecv error: recv got EOF from 127.5.164.193:55399 (error 108)
Metrics: {"server-negotiator.queue_time_us":696,"thread_start_us":542,"threads_started":1}
Aug 08 08:34:45 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:45 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:45.694064 15867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:45.684599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:56631)
0808 08:34:45.685182 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:45.685200 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:45.685333 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:45.685664 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:45.685667 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:45.686107 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:45.686299 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:45.686308 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:45.687477 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:45.687483 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:45.688407 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:45.688418 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:45.689159 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:45.689165 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:45.689347 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:45.689981 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:45.690000 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:45.693677 (+ 3677us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":314,"threads_started":1}
W20260808 08:34:45.694139 15866 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:45.684704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:56631 (local address 127.5.164.254:38085)
0808 08:34:45.684966 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:45.684972 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:45.685289 (+ 317us) server_negotiation.cc:407] Connection header received
0808 08:34:45.685448 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:45.685452 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:45.685519 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:45.685606 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:45.686463 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:45.687336 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:45.688553 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:45.688997 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:45.689127 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:45.693898 (+ 4771us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:56631: BlockingRecv error: recv got EOF from 127.5.164.194:56631 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 08 08:34:46 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:46 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:46.510216 15868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:46.500146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:45199)
0808 08:34:46.500648 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:46.500669 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:46.500794 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:46.501328 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:46.501331 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:46.501762 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:46.501940 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:46.501948 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:46.503206 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:46.503211 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:46.504288 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:46.504300 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:46.505002 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:46.505008 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:46.505207 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:46.505746 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:46.505762 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:46.509838 (+ 4076us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":259,"threads_started":1}
W20260808 08:34:46.510349 15869 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:46.500344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:45199 (local address 127.5.164.254:38085)
0808 08:34:46.501050 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:46.501055 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:46.501070 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:34:46.501115 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:46.501119 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:46.501186 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:46.501272 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:46.502104 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:46.503035 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:46.504429 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:46.504846 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:46.504977 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:46.510057 (+ 5080us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.195:45199: BlockingRecv error: recv got EOF from 127.5.164.195:45199 (error 108)
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":463,"threads_started":1}
Aug 08 08:34:46 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:46 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:46.516577 15870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:46.506814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:59961)
0808 08:34:46.507524 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:46.507545 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:46.507676 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:46.508153 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:46.508159 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:46.508529 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:46.508747 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:46.508756 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:46.509777 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:46.509782 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:46.510900 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:46.510912 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:46.511653 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:46.511660 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:46.511845 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:46.512445 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:46.512462 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:46.516204 (+ 3742us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":486,"threads_started":1}
W20260808 08:34:46.516754 15871 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:46.506863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:59961 (local address 127.5.164.254:38085)
0808 08:34:46.507882 (+ 1019us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:46.507887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:46.507899 (+ 12us) server_negotiation.cc:407] Connection header received
0808 08:34:46.507934 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:46.507937 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:46.508007 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:46.508115 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:46.508889 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:46.509628 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:46.511045 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:46.511497 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:46.511626 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:46.516411 (+ 4785us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:59961: BlockingRecv error: recv got EOF from 127.5.164.193:59961 (error 108)
Metrics: {"server-negotiator.queue_time_us":922,"thread_start_us":769,"threads_started":1}
Aug 08 08:34:46 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:46 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:46.704674 15873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:46.695321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:34251)
0808 08:34:46.695896 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:46.695913 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:46.696052 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:46.696462 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:46.696467 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:46.696982 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:46.697230 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:46.697244 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:46.698358 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:46.698361 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:46.699357 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:46.699370 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:46.700011 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:46.700015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:46.700136 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:46.700807 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:46.700826 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:46.704397 (+ 3571us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":302,"threads_started":1}
W20260808 08:34:46.704805 15871 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:46.695457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:34251 (local address 127.5.164.254:38085)
0808 08:34:46.695655 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:46.695659 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:46.696003 (+ 344us) server_negotiation.cc:407] Connection header received
0808 08:34:46.696209 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:46.696214 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:46.696300 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:46.696388 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:46.697412 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:46.698219 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:46.699480 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:46.699880 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:46.699987 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:46.704566 (+ 4579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:34251: BlockingRecv error: recv got EOF from 127.5.164.194:34251 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 08 08:34:47 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:47 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:47.521270 15874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:47.511421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:47731)
0808 08:34:47.511989 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:47.512019 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:47.512129 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:47.512456 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:47.512459 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:47.512819 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:47.512988 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:47.512996 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:47.514012 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:47.514016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:47.514920 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:47.514931 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:47.515658 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:47.515663 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:47.515795 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:47.516465 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:47.516484 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:47.520876 (+ 4392us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":290,"threads_started":1}
W20260808 08:34:47.521490 15875 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:47.511500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:47731 (local address 127.5.164.254:38085)
0808 08:34:47.512058 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:47.512063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:47.512082 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:34:47.512233 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:47.512237 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:47.512308 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:47.512397 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:47.513120 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:47.513879 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:47.515055 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:47.515519 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:47.515616 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:47.521109 (+ 5493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.195:47731: BlockingRecv error: recv got EOF from 127.5.164.195:47731 (error 108)
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":290,"threads_started":1}
Aug 08 08:34:47 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:47 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:47.528067 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:47.517633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:59543)
0808 08:34:47.518163 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:47.518185 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:47.518325 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:47.519430 (+ 1105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:47.519437 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:47.519925 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:47.520144 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:47.520155 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:47.521203 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:47.521208 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:47.522627 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:47.522641 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:47.523413 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:47.523419 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:47.523606 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:47.524194 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:47.524211 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:47.527670 (+ 3459us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":281,"threads_started":1}
W20260808 08:34:47.528256 15877 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:47.517688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:59543 (local address 127.5.164.254:38085)
0808 08:34:47.518495 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:47.518500 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:47.518807 (+ 307us) server_negotiation.cc:407] Connection header received
0808 08:34:47.518895 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:47.518900 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:47.518984 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:47.519122 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:47.520287 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:47.521054 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:47.522771 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:47.523265 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:47.523395 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:47.527920 (+ 4525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:59543: BlockingRecv error: recv got EOF from 127.5.164.193:59543 (error 108)
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":517,"threads_started":1}
Aug 08 08:34:47 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:47 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:47.714993 15878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:47.705639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:41275)
0808 08:34:47.706322 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:47.706338 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:47.706455 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:47.706775 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:47.706778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:47.707196 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:47.707365 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:47.707374 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:47.708425 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:47.708428 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:47.709489 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:47.709501 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:47.710345 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:47.710353 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:47.710504 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:47.711245 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:47.711265 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:47.714738 (+ 3473us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":420,"threads_started":1}
W20260808 08:34:47.715224 15877 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:47.705735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:41275 (local address 127.5.164.254:38085)
0808 08:34:47.705910 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:47.705915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:47.706424 (+ 509us) server_negotiation.cc:407] Connection header received
0808 08:34:47.706561 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:47.706565 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:47.706631 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:47.706731 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:47.707502 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:47.708316 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:47.709629 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:47.710185 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:47.710308 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:47.714915 (+ 4607us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:41275: BlockingRecv error: recv got EOF from 127.5.164.194:41275 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 08:34:48 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:48 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:48.535544 15879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:48.522365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:39053)
0808 08:34:48.523030 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:48.523058 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:48.523241 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:48.523696 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:48.523699 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:48.524064 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:48.524248 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:48.524257 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:48.526026 (+ 1769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:48.526034 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:48.527682 (+ 1648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:48.527697 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:48.528528 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:48.528534 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:48.528717 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:48.529497 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:48.529531 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:48.535168 (+ 5637us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":317,"threads_started":1}
W20260808 08:34:48.535702 15880 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:48.522439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:39053 (local address 127.5.164.254:38085)
0808 08:34:48.523324 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:48.523333 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:48.523358 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:34:48.523435 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:48.523442 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:48.523538 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:48.523678 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:48.524392 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:48.525807 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:48.527864 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:48.528379 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:48.528513 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:48.535391 (+ 6878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.195:39053: BlockingRecv error: recv got EOF from 127.5.164.195:39053 (error 108)
Metrics: {"server-negotiator.queue_time_us":737,"thread_start_us":584,"threads_started":1}
Aug 08 08:34:48 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:48 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 08:34:48.548480 15880 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:48.529088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:42101 (local address 127.5.164.254:38085)
0808 08:34:48.536692 (+ 7604us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:48.536696 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:48.539808 (+ 3112us) server_negotiation.cc:407] Connection header received
0808 08:34:48.540054 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:48.540079 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:48.540158 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:48.540283 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:48.541073 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:48.541827 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:48.543060 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:48.543534 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:48.543668 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:48.548297 (+ 4629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:42101: BlockingRecv error: recv got EOF from 127.5.164.193:42101 (error 108)
Metrics: {"server-negotiator.queue_time_us":7525,"thread_start_us":9581,"threads_started":1}
I20260808 08:34:48.548559 15881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:48.529012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:42101)
0808 08:34:48.539710 (+ 10698us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:48.539728 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:48.539875 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:48.540319 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:48.540324 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:48.540772 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:48.540931 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:48.540939 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:48.541959 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:48.541965 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:48.542921 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:48.542933 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:48.543683 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:48.543689 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:48.543875 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:48.544465 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:48.544483 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:48.548146 (+ 3663us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":10548,"thread_start_us":10233,"threads_started":1}
Aug 08 08:34:48 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:48 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:48.730279 15883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:48.715901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:38933)
0808 08:34:48.716490 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:48.716506 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:48.716658 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:48.717008 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:48.717012 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:48.717473 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:48.717630 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:48.717638 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:48.718735 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:48.718743 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:48.719822 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:48.719833 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:48.720628 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:48.720633 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:48.720821 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:48.726083 (+ 5262us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:48.726103 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:48.730046 (+ 3943us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":342,"threads_started":1}
W20260808 08:34:48.730568 15880 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:48.716097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:38933 (local address 127.5.164.254:38085)
0808 08:34:48.716321 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:48.716329 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:48.716584 (+ 255us) server_negotiation.cc:407] Connection header received
0808 08:34:48.716809 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:48.716813 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:48.716875 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:48.716976 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:48.717779 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:48.718590 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:48.719953 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:48.720484 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:48.720613 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:48.730283 (+ 9670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:38933: BlockingRecv error: recv got EOF from 127.5.164.194:38933 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 08 08:34:49 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:49 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:49.546054 15884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:49.536882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:44931)
0808 08:34:49.537623 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:49.537653 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:49.537793 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:49.538228 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:49.538232 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:49.538677 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:49.538832 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:49.538841 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:49.539907 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:49.539912 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:49.540879 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:49.540890 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:49.541573 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:49.541578 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:49.541744 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:49.542422 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:49.542441 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:49.545805 (+ 3364us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":373,"threads_started":1}
W20260808 08:34:49.546308 15885 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:49.536965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:44931 (local address 127.5.164.254:38085)
0808 08:34:49.537890 (+ 925us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:49.537896 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:49.537916 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:34:49.537972 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:49.537977 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:49.538074 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:49.538162 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:49.538974 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:49.539767 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:49.541001 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:49.541419 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:49.541514 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:49.546028 (+ 4514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.195:44931: BlockingRecv error: recv got EOF from 127.5.164.195:44931 (error 108)
Metrics: {"server-negotiator.queue_time_us":800,"thread_start_us":628,"threads_started":1}
Aug 08 08:34:49 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:49 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:49.558328 15886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:49.549603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:36005)
0808 08:34:49.550162 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:49.550185 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:49.550291 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:49.550552 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:49.550555 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:49.550936 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:49.551109 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:49.551118 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:49.552072 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:49.552075 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:49.552978 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:49.552988 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:49.553638 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:49.553642 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:49.553768 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:49.554397 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:49.554415 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:49.558097 (+ 3682us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":301,"threads_started":1}
W20260808 08:34:49.558593 15885 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:49.549611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:36005 (local address 127.5.164.254:38085)
0808 08:34:49.549893 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:49.549899 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:49.550254 (+ 355us) server_negotiation.cc:407] Connection header received
0808 08:34:49.550377 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:49.550381 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:49.550435 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:49.550513 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:49.551278 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:49.551938 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:49.553110 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:49.553507 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:49.553595 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:49.558320 (+ 4725us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:36005: BlockingRecv error: recv got EOF from 127.5.164.193:36005 (error 108)
Metrics: {"server-negotiator.queue_time_us":166}
Aug 08 08:34:49 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:49 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:49.742180 15888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:49.731515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:53209)
0808 08:34:49.732146 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:49.732167 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:49.732319 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:49.733365 (+ 1046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:49.733371 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:49.733903 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:49.734094 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:49.734103 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:49.735303 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:49.735308 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:49.736589 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:49.736602 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:49.737582 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:49.737588 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:49.737771 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:49.738326 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:49.738343 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:49.741906 (+ 3563us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":333,"threads_started":1}
W20260808 08:34:49.742436 15885 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:49.731662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:53209 (local address 127.5.164.254:38085)
0808 08:34:49.732013 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:49.732020 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:49.732246 (+ 226us) server_negotiation.cc:407] Connection header received
0808 08:34:49.733075 (+ 829us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:49.733081 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:49.733172 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:49.733279 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:49.734235 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:49.735113 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:49.736741 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:49.737418 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:49.737551 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:49.742129 (+ 4578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:53209: BlockingRecv error: recv got EOF from 127.5.164.194:53209 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 08 08:34:50 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:50 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:50.556799 15889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:50.547230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:54449)
0808 08:34:50.548334 (+ 1104us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:50.548368 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:50.548492 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:50.548844 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:50.548848 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:50.549297 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:50.549478 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:50.549487 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:50.550547 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:50.550550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:50.551573 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:50.551586 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:50.552260 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:50.552264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:50.552385 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:50.553036 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:50.553054 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:50.556557 (+ 3503us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":985,"thread_start_us":882,"threads_started":1}
W20260808 08:34:50.557045 15890 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:50.547229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:54449 (local address 127.5.164.254:38085)
0808 08:34:50.547951 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:50.547962 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:50.548475 (+ 513us) server_negotiation.cc:407] Connection header received
0808 08:34:50.548600 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:50.548604 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:50.548671 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:50.548766 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:50.549623 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:50.550419 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:50.551709 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:50.552124 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:50.552220 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:50.556759 (+ 4539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.195:54449: BlockingRecv error: recv got EOF from 127.5.164.195:54449 (error 108)
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":366,"threads_started":1}
Aug 08 08:34:50 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:50 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:50.568054 15891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:50.559306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:33175)
0808 08:34:50.559959 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:50.559975 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:50.560088 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:50.560381 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:50.560385 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:50.560791 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:50.560968 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:50.560975 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:50.561921 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:50.561925 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:50.562906 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:50.562917 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:50.563691 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:50.563696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:50.563805 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:50.564358 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:50.564375 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:50.567799 (+ 3424us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":276,"threads_started":1}
W20260808 08:34:50.568158 15890 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:50.559360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:33175 (local address 127.5.164.254:38085)
0808 08:34:50.559551 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:50.559557 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:50.560042 (+ 485us) server_negotiation.cc:407] Connection header received
0808 08:34:50.560179 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:50.560183 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:50.560251 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:50.560333 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:50.561083 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:50.561795 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:50.563038 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:50.563539 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:50.563635 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:50.567985 (+ 4350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:33175: BlockingRecv error: recv got EOF from 127.5.164.193:33175 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 08 08:34:50 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:50 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:50.752544 15892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:50.743364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:44477)
0808 08:34:50.744018 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:50.744035 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:50.744154 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:50.744489 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:50.744492 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:50.744917 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:50.745099 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:50.745108 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:50.746126 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:50.746130 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:50.747078 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:50.747090 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:50.747799 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:50.747803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:50.747915 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:50.748572 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:50.748591 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:50.752186 (+ 3595us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":314,"threads_started":1}
W20260808 08:34:50.752707 15890 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:50.743366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:44477 (local address 127.5.164.254:38085)
0808 08:34:50.743556 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:50.743560 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:50.744105 (+ 545us) server_negotiation.cc:407] Connection header received
0808 08:34:50.744271 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:50.744275 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:50.744351 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:50.744428 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:50.745235 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:50.745995 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:50.747242 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:50.747658 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:50.747754 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:50.752449 (+ 4695us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:44477: BlockingRecv error: recv got EOF from 127.5.164.194:44477 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 08 08:34:51 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:51 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:51.567989 15894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:51.557764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:37259)
0808 08:34:51.558359 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:51.558382 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:51.558489 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:51.559030 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:51.559034 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:51.559539 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:51.559727 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:51.559737 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:51.560857 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:51.560861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:51.561847 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:51.561859 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:51.562601 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:51.562605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:51.562730 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:51.563503 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:51.563522 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:51.567586 (+ 4064us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":272,"threads_started":1}
W20260808 08:34:51.568120 15893 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:51.557878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:37259 (local address 127.5.164.254:38085)
0808 08:34:51.558763 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:51.558767 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:51.558784 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:34:51.558831 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:51.558834 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:51.558894 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:51.558983 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:51.559877 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:51.560709 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:51.562010 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:51.562466 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:51.562561 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:51.567810 (+ 5249us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.195:37259: BlockingRecv error: recv got EOF from 127.5.164.195:37259 (error 108)
Metrics: {"server-negotiator.queue_time_us":788,"thread_start_us":652,"threads_started":1}
Aug 08 08:34:51 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:51 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:51.578426 15895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:51.569066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:57345)
0808 08:34:51.569590 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:51.569606 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:51.569716 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:51.570033 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:51.570036 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:51.570440 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:51.570617 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:51.570626 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:51.571706 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:51.571711 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:51.572709 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:51.572721 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:51.573585 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:51.573590 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:51.573719 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:51.574445 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:51.574464 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:51.578143 (+ 3679us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":260,"threads_started":1}
W20260808 08:34:51.578609 15893 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:51.569174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:57345 (local address 127.5.164.254:38085)
0808 08:34:51.569391 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:51.569397 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:51.569684 (+ 287us) server_negotiation.cc:407] Connection header received
0808 08:34:51.569811 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:51.569815 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:51.569879 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:51.569958 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:51.570745 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:51.571541 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:51.572831 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:51.573426 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:51.573523 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:51.578373 (+ 4850us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:57345: BlockingRecv error: recv got EOF from 127.5.164.193:57345 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 08 08:34:51 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:51 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:51.764245 15896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:51.753813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:59579)
0808 08:34:51.754698 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:51.754722 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:51.754885 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:51.755353 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:51.755359 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:51.755945 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:51.756241 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:51.756252 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:51.757625 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:51.757629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:51.758617 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:51.758629 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:51.759431 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:51.759436 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:51.759560 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:51.760206 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:51.760225 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:51.763984 (+ 3759us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":729,"thread_start_us":560,"threads_started":1}
W20260808 08:34:51.764542 15893 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:51.753971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:59579 (local address 127.5.164.254:38085)
0808 08:34:51.754207 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:51.754216 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:51.754821 (+ 605us) server_negotiation.cc:407] Connection header received
0808 08:34:51.755068 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:51.755073 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:51.755182 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:51.755288 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:51.756397 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:51.757478 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:51.758758 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:51.759253 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:51.759351 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:51.764227 (+ 4876us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:59579: BlockingRecv error: recv got EOF from 127.5.164.194:59579 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 08:34:52 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:52 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:52.578840 15897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:52.569214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:44283)
0808 08:34:52.569788 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:52.569809 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:52.569922 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:52.570243 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:52.570246 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:52.570663 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:52.570840 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:52.570848 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:52.571932 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:52.571935 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:52.573003 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:52.573016 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:52.573914 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:52.573919 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:52.574046 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:52.574653 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:52.574670 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:52.578537 (+ 3867us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":293,"threads_started":1}
W20260808 08:34:52.579206 15898 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:52.569273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:44283 (local address 127.5.164.254:38085)
0808 08:34:52.569814 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:52.569819 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:52.569884 (+ 65us) server_negotiation.cc:407] Connection header received
0808 08:34:52.570051 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:52.570055 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:52.570118 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:52.570211 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:52.570977 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:52.571824 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:52.573162 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:52.573701 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:52.573802 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:52.578885 (+ 5083us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.195:44283: BlockingRecv error: recv got EOF from 127.5.164.195:44283 (error 108)
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":302,"threads_started":1}
Aug 08 08:34:52 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:52 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:52.588121 15899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:52.579421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:60325)
0808 08:34:52.580118 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:52.580138 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:52.580287 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:52.580645 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:52.580650 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:52.581067 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:52.581214 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:52.581222 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:52.582212 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:52.582216 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:52.583131 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:52.583188 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:52.583820 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:52.583824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:52.583950 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:52.584554 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:52.584571 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:52.587906 (+ 3335us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":470,"threads_started":1}
W20260808 08:34:52.588272 15898 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:52.579744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:60325 (local address 127.5.164.254:38085)
0808 08:34:52.579920 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:52.579926 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:52.580251 (+ 325us) server_negotiation.cc:407] Connection header received
0808 08:34:52.580411 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:52.580419 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:52.580491 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:52.580607 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:52.581332 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:52.582090 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:52.583305 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:52.583697 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:52.583786 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:52.588066 (+ 4280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:60325: BlockingRecv error: recv got EOF from 127.5.164.193:60325 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 08:34:52 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:52 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:52.774783 15900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:52.765329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:45113)
0808 08:34:52.765916 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:52.765932 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:52.766047 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:52.766366 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:52.766370 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:52.766823 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:52.766970 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:52.766979 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:52.768062 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:52.768066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:52.768989 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:52.768999 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:52.770009 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:52.770013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:52.770136 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:52.770829 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:52.770859 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:52.774523 (+ 3664us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":335,"threads_started":1}
W20260808 08:34:52.774960 15898 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:52.765424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:45113 (local address 127.5.164.254:38085)
0808 08:34:52.765605 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:52.765610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:52.766006 (+ 396us) server_negotiation.cc:407] Connection header received
0808 08:34:52.766168 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:52.766172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:52.766237 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:52.766323 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:52.767105 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:52.767936 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:52.769145 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:52.769779 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:52.769908 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:52.774703 (+ 4795us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:45113: BlockingRecv error: recv got EOF from 127.5.164.194:45113 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 08:34:53 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:53 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:53.592566 15901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:53.580244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:49051)
0808 08:34:53.580822 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:53.580855 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:53.580985 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:53.581508 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:53.581516 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:53.582135 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:53.582388 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:53.582406 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:53.583674 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:53.583681 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:53.585263 (+ 1582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:53.585278 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:53.586679 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:53.586688 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:53.586929 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:53.587629 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:53.587660 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:53.592226 (+ 4566us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":253,"threads_started":1}
W20260808 08:34:53.592756 15902 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:53.580294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:49051 (local address 127.5.164.254:38085)
0808 08:34:53.581161 (+ 867us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:53.581167 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:53.581188 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:34:53.581255 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:53.581261 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:53.581343 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:53.581478 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:53.582558 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:53.583523 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:53.585692 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:53.586505 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:53.586636 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:53.592440 (+ 5804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.195:49051: BlockingRecv error: recv got EOF from 127.5.164.195:49051 (error 108)
Metrics: {"server-negotiator.queue_time_us":714,"thread_start_us":567,"threads_started":1}
Aug 08 08:34:53 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:53 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:53.605173 15903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:53.589229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:38221)
0808 08:34:53.595546 (+ 6317us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:53.595563 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:53.595719 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:53.596296 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:53.596300 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:53.596706 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:53.596863 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:53.596872 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:53.598627 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:53.598663 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:53.599986 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:53.600001 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:53.600685 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:53.600689 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:53.600800 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:53.601355 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:53.601373 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:53.604924 (+ 3551us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":6199,"thread_start_us":6101,"threads_started":1}
W20260808 08:34:53.605561 15904 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:53.589280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:38221 (local address 127.5.164.254:38085)
0808 08:34:53.589817 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:53.589823 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:53.595653 (+ 5830us) server_negotiation.cc:407] Connection header received
0808 08:34:53.595843 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:53.595848 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:53.595940 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:53.596059 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:53.597333 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:53.598485 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:53.600121 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:53.600541 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:53.600643 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:53.605205 (+ 4562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:38221: BlockingRecv error: recv got EOF from 127.5.164.193:38221 (error 108)
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":244,"threads_started":1}
Aug 08 08:34:53 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:53 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:53.790470 15905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:53.775835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:42229)
0808 08:34:53.776398 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:53.776414 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:53.776577 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:53.776925 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:53.776928 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:53.777442 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:53.777666 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:53.777679 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:53.778640 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:53.778644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:53.779700 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:53.779711 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:53.780400 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:53.780404 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:53.780509 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:53.786557 (+ 6048us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:53.786577 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:53.790212 (+ 3635us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":303,"threads_started":1}
W20260808 08:34:53.790723 15904 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:53.775938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:42229 (local address 127.5.164.254:38085)
0808 08:34:53.776198 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:53.776204 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:53.776518 (+ 314us) server_negotiation.cc:407] Connection header received
0808 08:34:53.776717 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:53.776721 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:53.776786 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:53.776867 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:53.777817 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:53.778530 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:53.779819 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:53.780219 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:53.780359 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:53.790443 (+ 10084us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:42229: BlockingRecv error: recv got EOF from 127.5.164.194:42229 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 08 08:34:54 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:54 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:54.602255 15906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:54.593660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:56663)
0808 08:34:54.594245 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:54.594273 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:54.594402 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:54.594691 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:54.594694 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:54.595083 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:54.595277 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:54.595286 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:54.596280 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:54.596283 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:54.597267 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:54.597278 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:54.597902 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:54.597906 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:54.598019 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:54.598600 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:54.598616 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:54.602001 (+ 3385us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":257,"threads_started":1}
W20260808 08:34:54.602512 15907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:54.593876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:56663 (local address 127.5.164.254:38085)
0808 08:34:54.594410 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:54.594415 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:54.594432 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:34:54.594485 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:54.594488 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:54.594552 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:54.594645 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:54.595409 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:54.596153 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:54.597388 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:54.597779 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:54.597867 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:54.602197 (+ 4330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.195:56663: BlockingRecv error: recv got EOF from 127.5.164.195:56663 (error 108)
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":278,"threads_started":1}
Aug 08 08:34:54 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:54 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:54.614563 15908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:54.606136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:47645)
0808 08:34:54.606637 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:54.606654 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:54.606761 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:54.607026 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:54.607029 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:54.607444 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:54.607619 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:54.607628 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:54.608594 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:54.608602 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:54.609609 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:54.609621 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:54.610236 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:54.610239 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:54.610358 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:54.610967 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:54.610985 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:54.614288 (+ 3303us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":266,"threads_started":1}
W20260808 08:34:54.614615 15907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:54.606185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:47645 (local address 127.5.164.254:38085)
0808 08:34:54.606342 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:54.606346 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:54.606723 (+ 377us) server_negotiation.cc:407] Connection header received
0808 08:34:54.606851 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:54.606854 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:54.606908 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:54.606983 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:54.607737 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:54.608451 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:54.609727 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:54.610113 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:54.610199 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:54.614444 (+ 4245us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:47645: BlockingRecv error: recv got EOF from 127.5.164.193:47645 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 08 08:34:54 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:54 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:54.800827 15909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:54.791476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:44319)
0808 08:34:54.792026 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:54.792042 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:54.792174 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:54.792489 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:54.792492 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:54.792913 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:54.793091 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:54.793099 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:54.794231 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:54.794236 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:54.795413 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:54.795426 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:54.796298 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:54.796302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:54.796442 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:54.797049 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:54.797068 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:54.800589 (+ 3521us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":309,"threads_started":1}
W20260808 08:34:54.801062 15907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:54.791609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:44319 (local address 127.5.164.254:38085)
0808 08:34:54.791788 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:54.791792 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:54.792116 (+ 324us) server_negotiation.cc:407] Connection header received
0808 08:34:54.792279 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:54.792282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:54.792358 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:54.792444 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:54.793230 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:54.794057 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:54.795547 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:54.796158 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:54.796254 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:54.800798 (+ 4544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:44319: BlockingRecv error: recv got EOF from 127.5.164.194:44319 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 08 08:34:55 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:55 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:55.613368 15911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:55.603394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:59965)
0808 08:34:55.604201 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:55.604224 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:55.604339 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:55.604714 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:55.604717 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:55.605235 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:55.605419 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:55.605429 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:55.606416 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:55.606420 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:55.607407 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:55.607419 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:55.608107 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:55.608111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:55.608235 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:55.608835 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:55.608852 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:55.613152 (+ 4300us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":670,"thread_start_us":561,"threads_started":1}
W20260808 08:34:55.613730 15910 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:55.603426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:59965 (local address 127.5.164.254:38085)
0808 08:34:55.603958 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:55.603963 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:55.604298 (+ 335us) server_negotiation.cc:407] Connection header received
0808 08:34:55.604452 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:55.604459 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:55.604558 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:55.604691 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:55.605553 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:55.606291 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:55.607531 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:55.607968 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:55.608084 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:55.613332 (+ 5248us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.195:59965: BlockingRecv error: recv got EOF from 127.5.164.195:59965 (error 108)
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":284,"threads_started":1}
Aug 08 08:34:55 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:55 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:55.625236 15912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:55.615468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:45225)
0808 08:34:55.616204 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:55.616230 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:55.616345 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:55.616621 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:55.616624 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:55.617007 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:55.617176 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:55.617184 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:55.618264 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:55.618267 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:55.619232 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:55.619247 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:55.620045 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:55.620049 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:55.620199 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:55.620844 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:55.620861 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:55.624841 (+ 3980us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":504,"threads_started":1}
W20260808 08:34:55.625303 15910 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:55.615565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:45225 (local address 127.5.164.254:38085)
0808 08:34:55.615802 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:55.615811 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:55.616323 (+ 512us) server_negotiation.cc:407] Connection header received
0808 08:34:55.616441 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:55.616445 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:55.616505 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:55.616590 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:55.617325 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:55.618117 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:55.619391 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:55.619900 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:55.620007 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:55.625060 (+ 5053us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:45225: BlockingRecv error: recv got EOF from 127.5.164.193:45225 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 08:34:55 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:55 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:55.811432 15913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:55.801823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:60711)
0808 08:34:55.802372 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:55.802389 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:55.802513 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:55.802888 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:55.802892 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:55.803460 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:55.803628 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:55.803636 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:55.805214 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:55.805219 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:55.806223 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:55.806235 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:55.806899 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:55.806904 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:55.807038 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:55.807740 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:55.807758 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:55.811126 (+ 3368us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":319,"threads_started":1}
W20260808 08:34:55.811638 15910 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:55.801939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:60711 (local address 127.5.164.254:38085)
0808 08:34:55.802213 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:55.802220 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:55.802470 (+ 250us) server_negotiation.cc:407] Connection header received
0808 08:34:55.802644 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:55.802648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:55.802765 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:55.802846 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:55.803858 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:55.805042 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:55.806363 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:55.806769 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:55.806861 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:55.811400 (+ 4539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:60711: BlockingRecv error: recv got EOF from 127.5.164.194:60711 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 08 08:34:56 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:56 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:56.624257 15914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:56.614307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:36411)
0808 08:34:56.615020 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:56.615046 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:56.615182 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:56.615549 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:56.615554 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:56.616017 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:56.616226 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:56.616235 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:56.617260 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:56.617264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:56.618240 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:56.618252 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:56.619128 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:56.619133 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:56.619362 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:56.620022 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:56.620074 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:56.623999 (+ 3925us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":384,"threads_started":1}
W20260808 08:34:56.624565 15915 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:56.614384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:36411 (local address 127.5.164.254:38085)
0808 08:34:56.614972 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:56.614995 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:56.615121 (+ 126us) server_negotiation.cc:407] Connection header received
0808 08:34:56.615290 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:56.615294 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:56.615367 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:56.615462 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:56.616371 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:56.617138 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:56.618370 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:56.618885 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:56.619029 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:56.624251 (+ 5222us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.195:36411: BlockingRecv error: recv got EOF from 127.5.164.195:36411 (error 108)
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":336,"threads_started":1}
Aug 08 08:34:56 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:56 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:56.636337 15916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:56.626321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:38529)
0808 08:34:56.626823 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:56.626839 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:56.626958 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:56.627323 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:56.627326 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:56.627705 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:56.627856 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:56.627865 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:56.628919 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:56.628923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:56.629847 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:56.629857 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:56.630635 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:56.630640 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:56.630783 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:56.631556 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:56.631575 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:56.636092 (+ 4517us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":299,"threads_started":1}
W20260808 08:34:56.636492 15915 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:56.626437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:38529 (local address 127.5.164.254:38085)
0808 08:34:56.626698 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:56.626704 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:56.626918 (+ 214us) server_negotiation.cc:407] Connection header received
0808 08:34:56.627064 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:56.627068 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:56.627134 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:56.627277 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:56.628003 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:56.628764 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:56.630013 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:56.630463 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:56.630575 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:56.636290 (+ 5715us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:38529: BlockingRecv error: recv got EOF from 127.5.164.193:38529 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 08 08:34:56 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:56 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:56.823397 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:56.812792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:33895)
0808 08:34:56.813653 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:56.813670 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:56.813809 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:56.814269 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:56.814273 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:56.814707 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:56.814860 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:56.814869 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:56.816122 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:56.816127 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:56.817084 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:56.817097 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:56.818034 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:56.818039 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:56.818246 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:56.819015 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:56.819037 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:56.822992 (+ 3955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":741,"thread_start_us":276,"threads_started":1}
W20260808 08:34:56.823491 15915 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:56.813050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:33895 (local address 127.5.164.254:38085)
0808 08:34:56.813349 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:56.813354 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:56.813769 (+ 415us) server_negotiation.cc:407] Connection header received
0808 08:34:56.813988 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:56.813993 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:56.814098 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:56.814198 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:56.815060 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:56.815931 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:56.817291 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:56.817822 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:56.817972 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:56.823269 (+ 5297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:33895: BlockingRecv error: recv got EOF from 127.5.164.194:33895 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Aug 08 08:34:57 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:57 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.195@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:57.634277 15918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:57.625263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.195:37267)
0808 08:34:57.625791 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:57.625815 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:57.625926 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:57.626254 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:57.626258 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:57.626676 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:57.626836 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:57.626845 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:57.627922 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:57.627926 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:57.628870 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:57.628883 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:57.629591 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:57.629595 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:57.629727 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:57.630379 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:57.630397 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:57.634023 (+ 3626us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":274,"threads_started":1}
W20260808 08:34:57.634580 15919 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:57.625322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:37267 (local address 127.5.164.254:38085)
0808 08:34:57.625895 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:57.625900 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:57.625917 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:34:57.626037 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:57.626040 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:57.626111 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:57.626208 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:57.626965 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:57.627781 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:57.629003 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:57.629448 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:57.629542 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:57.634300 (+ 4758us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.195:37267: BlockingRecv error: recv got EOF from 127.5.164.195:37267 (error 108)
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":311,"threads_started":1}
Aug 08 08:34:57 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:57 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.193@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:57.646685 15920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:57.637675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.193:34797)
0808 08:34:57.638176 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:57.638193 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:57.638320 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:57.638610 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:57.638613 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:57.638986 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:57.639234 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:57.639245 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:57.640292 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:57.640296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:57.641224 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:57.641235 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:57.641948 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:57.641952 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:57.642106 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:57.642760 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:57.642778 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:57.646419 (+ 3641us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":268,"threads_started":1}
W20260808 08:34:57.646943 15919 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:57.637814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:34797 (local address 127.5.164.254:38085)
0808 08:34:57.638106 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:57.638113 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:57.638290 (+ 177us) server_negotiation.cc:407] Connection header received
0808 08:34:57.638420 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:57.638424 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:57.638488 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:57.638562 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:57.639364 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:57.640102 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:57.641381 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:57.641814 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:57.641918 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:57.646707 (+ 4789us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.193:34797: BlockingRecv error: recv got EOF from 127.5.164.193:34797 (error 108)
Metrics: {"server-negotiator.queue_time_us":164}
Aug 08 08:34:57 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 08:34:57 dist-test-slave-chsk krb5kdc[14760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.5.164.194@KRBTEST.COM for oryx/127.5.164.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 08:34:57.833865 15921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:57.824555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38085 (local address 127.5.164.194:44315)
0808 08:34:57.825100 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:57.825116 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:57.825230 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:57.825546 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:57.825549 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:57.826004 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:57.826201 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:57.826210 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:57.827258 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:57.827261 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:57.828177 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:57.828188 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:57.828846 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:57.828850 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:57.828976 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:57.829556 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:34:57.829574 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:57.833627 (+ 4053us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.5.164.254:38085: Server oryx/127.5.164.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":296,"threads_started":1}
W20260808 08:34:57.834082 15919 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:34:57.824648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:44315 (local address 127.5.164.254:38085)
0808 08:34:57.824869 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:57.824874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:57.825187 (+ 313us) server_negotiation.cc:407] Connection header received
0808 08:34:57.825332 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:57.825335 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:57.825408 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:57.825491 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:57.826324 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:57.827077 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:57.828310 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:57.828714 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:57.828805 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:57.833798 (+ 4993us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.5.164.194:44315: BlockingRecv error: recv got EOF from 127.5.164.194:44315 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
I20260808 08:34:58.329211 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 15405
I20260808 08:34:58.342270 15924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:58.330376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55302 (local address 127.5.164.193:39151)
0808 08:34:58.331183 (+ 807us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:58.331194 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:58.331230 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:34:58.331305 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:58.331311 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:58.331568 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:58.331737 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:58.333167 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:58.334263 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:58.335637 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:58.336275 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:58.336413 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:58.338926 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:58.338934 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:58.338948 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:58.339008 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:58.341729 (+ 2721us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.5.164.193@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 08:34:58.342060 (+ 331us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55302: Request ticket server kudu/127.5.164.193@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":418,"threads_started":1}
W20260808 08:34:58.342404 15924 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55302: Request ticket server kudu/127.5.164.193@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 08:34:58.342414 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 15405: Not authorized: Client connection negotiation failed: client connection to 127.5.164.193:39151: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.5.164.193@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 08:34:58.342625 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 15405
I20260808 08:34:58.364151 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 15565
I20260808 08:34:58.377645 15925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:58.365279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47344 (local address 127.5.164.194:45049)
0808 08:34:58.365995 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:58.366004 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:58.366035 (+ 31us) server_negotiation.cc:407] Connection header received
0808 08:34:58.366112 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:58.366120 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:58.366442 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:58.366655 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:58.368054 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:58.369709 (+ 1655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:58.370852 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:58.371554 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:58.371657 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:58.374261 (+ 2604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:58.374269 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:58.374281 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:58.374325 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:58.377129 (+ 2804us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.5.164.194@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 08:34:58.377424 (+ 295us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47344: Request ticket server kudu/127.5.164.194@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":390,"threads_started":1}
W20260808 08:34:58.377803 15925 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47344: Request ticket server kudu/127.5.164.194@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 08:34:58.377875 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 15565: Not authorized: Client connection negotiation failed: client connection to 127.5.164.194:45049: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.5.164.194@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 08:34:58.378023 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 15565
I20260808 08:34:58.399617 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 15710
I20260808 08:34:58.412979 15926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:58.400810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50714 (local address 127.5.164.195:39241)
0808 08:34:58.401446 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:58.401454 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:58.401480 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:34:58.401544 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:58.401550 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:58.401791 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:58.402013 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:58.403667 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:58.404784 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:58.406019 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:58.406570 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:58.406726 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:58.409398 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:58.409407 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:58.409420 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:34:58.409476 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:58.412252 (+ 2776us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.5.164.195@KRBTEST.COM not found in keytab (ticket kvno 2)
0808 08:34:58.412622 (+ 370us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50714: Request ticket server kudu/127.5.164.195@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":330,"threads_started":1}
W20260808 08:34:58.413003 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 15710: Not authorized: Client connection negotiation failed: client connection to 127.5.164.195:39241: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.5.164.195@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260808 08:34:58.413095 15926 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50714: Request ticket server kudu/127.5.164.195@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260808 08:34:58.413177 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 15710
I20260808 08:34:58.429239 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 15331
I20260808 08:34:58.430699 15397 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:34:58.552801 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 15331
2026-08-08T08:34:58Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21950 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T08:34:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:34:58Z Disabled control of system clock
I20260808 08:34:58.645349 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:41761
--webserver_interface=127.5.164.254
--webserver_port=0
--builtin_ntp_servers=127.5.164.212:37587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:41761
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 08:34:58.987828 15932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:58.988173 15932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:58.988317 15932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:58.995836 15932 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:34:58.995951 15932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:58.996094 15932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:58.996206 15932 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:34:58.996292 15932 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:34:59.006157 15932 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:37587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:41761
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:41761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:59.007649 15932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:59.009500 15932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:59.021780 15937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:59.021867 15938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:59.021821 15941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:59.022127 15932 server_base.cc:1034] running on GCE node
I20260808 08:34:59.023231 15932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:59.024636 15932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:59.025875 15932 hybrid_clock.cc:648] HybridClock initialized: now 1786178099025822 us; error 43 us; skew 500 ppm
I20260808 08:34:59.026253 15932 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:34:59.032021 15932 webserver.cc:460] Webserver started at http://127.5.164.254:44627/ using document root <none> and password file <none>
I20260808 08:34:59.032785 15932 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:59.032929 15932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:59.033281 15932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:59.036412 15932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "489d081cb78c4481b629ee9906131170"
format_stamp: "Formatted at 2026-08-08 08:34:59 on dist-test-slave-chsk"
server_key: "7c953fceb390f7374b0f18d5b16e471d"
server_key_iv: "6e0cf4b38efed13e3034b9cdd534468e"
server_key_version: "encryptionkey@0"
I20260808 08:34:59.037287 15932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "489d081cb78c4481b629ee9906131170"
format_stamp: "Formatted at 2026-08-08 08:34:59 on dist-test-slave-chsk"
server_key: "7c953fceb390f7374b0f18d5b16e471d"
server_key_iv: "6e0cf4b38efed13e3034b9cdd534468e"
server_key_version: "encryptionkey@0"
I20260808 08:34:59.042801 15932 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 08:34:59.046521 15948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:59.047995 15932 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:34:59.048198 15932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "489d081cb78c4481b629ee9906131170"
format_stamp: "Formatted at 2026-08-08 08:34:59 on dist-test-slave-chsk"
server_key: "7c953fceb390f7374b0f18d5b16e471d"
server_key_iv: "6e0cf4b38efed13e3034b9cdd534468e"
server_key_version: "encryptionkey@0"
I20260808 08:34:59.048435 15932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:59.070958 15932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:59.071925 15932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:59.072244 15932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:59.091923 15932 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:41761
I20260808 08:34:59.091977 16003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:41761 every 8 connection(s)
I20260808 08:34:59.093313 15932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:34:59.097223 16004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:34:59.101910 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 15932
I20260808 08:34:59.102149 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:34:59.102833 5779 external_mini_cluster.cc:1428] Setting key 56bf15e499badd1d612532ff9b446d37
I20260808 08:34:59.109236 16004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170: Bootstrap starting.
I20260808 08:34:59.112715 16004 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170: Neither blocks nor log segments found. Creating new log.
I20260808 08:34:59.113886 16004 log.cc:824] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170: Log is configured to *not* fsync() on all Append() calls
I20260808 08:34:59.117856 16004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170: No bootstrap required, opened a new log
I20260808 08:34:59.118218 16007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:59.105142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42080 (local address 127.5.164.254:41761)
0808 08:34:59.106221 (+ 1079us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:59.106244 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:59.106288 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:34:59.108206 (+ 1918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:59.108234 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:59.108754 (+ 520us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:59.109195 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:59.109949 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:59.111391 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:59.112793 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:59.113587 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:59.113805 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:59.115254 (+ 1449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:59.115266 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:59.115283 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:59.116015 (+ 732us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:59.116135 (+ 120us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:59.116166 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:59.116291 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:59.116539 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 08:34:59.116894 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":371,"threads_started":1}
I20260808 08:34:59.125841 16004 raft_consensus.cc:348] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "489d081cb78c4481b629ee9906131170" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 41761 } }
I20260808 08:34:59.126241 16004 raft_consensus.cc:374] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:34:59.126324 16004 raft_consensus.cc:729] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 489d081cb78c4481b629ee9906131170, State: Initialized, Role: FOLLOWER
I20260808 08:34:59.126840 16004 consensus_queue.cc:260] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "489d081cb78c4481b629ee9906131170" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 41761 } }
I20260808 08:34:59.127048 16004 raft_consensus.cc:388] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:34:59.127218 16004 raft_consensus.cc:482] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:34:59.127393 16004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:34:59.129642 16004 raft_consensus.cc:504] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "489d081cb78c4481b629ee9906131170" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 41761 } }
I20260808 08:34:59.130257 16004 leader_election.cc:302] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 489d081cb78c4481b629ee9906131170; no voters:
I20260808 08:34:59.131048 16004 leader_election.cc:288] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:34:59.131220 16009 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:34:59.131956 16009 raft_consensus.cc:686] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [term 1 LEADER]: Becoming Leader. State: Replica: 489d081cb78c4481b629ee9906131170, State: Running, Role: LEADER
I20260808 08:34:59.132539 16009 consensus_queue.cc:237] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "489d081cb78c4481b629ee9906131170" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 41761 } }
I20260808 08:34:59.133322 16004 sys_catalog.cc:564] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:34:59.135679 16010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "489d081cb78c4481b629ee9906131170" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "489d081cb78c4481b629ee9906131170" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 41761 } } }
I20260808 08:34:59.136161 16010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:59.136047 16013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 489d081cb78c4481b629ee9906131170. Latest consensus state: current_term: 1 leader_uuid: "489d081cb78c4481b629ee9906131170" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "489d081cb78c4481b629ee9906131170" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 41761 } } }
I20260808 08:34:59.136380 16013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170 [sys.catalog]: This master's current role is: LEADER
I20260808 08:34:59.138043 16021 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:34:59.143484 16021 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:34:59.153108 16021 catalog_manager.cc:1347] Generated new cluster ID: 087c860520774a8292f4f433740abe2c
I20260808 08:34:59.153256 16021 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:34:59.164141 16021 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:34:59.165985 16021 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:34:59.181721 16021 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 489d081cb78c4481b629ee9906131170: Generated new TSK 0
I20260808 08:34:59.182929 16021 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:34:59.194222 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:41761
--builtin_ntp_servers=127.5.164.212:37587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 08:34:59.547999 16033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:34:59.548286 16033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:34:59.548458 16033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:34:59.556342 16033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:34:59.556483 16033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:34:59.556672 16033 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:34:59.566282 16033 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:37587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:41761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:34:59.567688 16033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:34:59.569537 16033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:34:59.583242 16039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:59.583199 16040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:34:59.583372 16042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:34:59.584477 16033 server_base.cc:1034] running on GCE node
I20260808 08:34:59.585179 16033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:34:59.586287 16033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:34:59.587530 16033 hybrid_clock.cc:648] HybridClock initialized: now 1786178099587441 us; error 65 us; skew 500 ppm
I20260808 08:34:59.587921 16033 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:34:59.590449 16033 webserver.cc:460] Webserver started at http://127.5.164.193:44397/ using document root <none> and password file <none>
I20260808 08:34:59.591303 16033 fs_manager.cc:359] Metadata directory not provided
I20260808 08:34:59.591434 16033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:34:59.591804 16033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:34:59.594843 16033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "b8e5c5a711b54fe7bb37d27a8a4fac13"
format_stamp: "Formatted at 2026-08-08 08:34:59 on dist-test-slave-chsk"
server_key: "04f63bfb1b1185ff29dab0e59588c612"
server_key_iv: "ff26ba892f90a50496f34a2b3e63a207"
server_key_version: "encryptionkey@0"
I20260808 08:34:59.595782 16033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "b8e5c5a711b54fe7bb37d27a8a4fac13"
format_stamp: "Formatted at 2026-08-08 08:34:59 on dist-test-slave-chsk"
server_key: "04f63bfb1b1185ff29dab0e59588c612"
server_key_iv: "ff26ba892f90a50496f34a2b3e63a207"
server_key_version: "encryptionkey@0"
I20260808 08:34:59.601028 16033 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:34:59.604637 16048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:59.605983 16033 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:34:59.606207 16033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "b8e5c5a711b54fe7bb37d27a8a4fac13"
format_stamp: "Formatted at 2026-08-08 08:34:59 on dist-test-slave-chsk"
server_key: "04f63bfb1b1185ff29dab0e59588c612"
server_key_iv: "ff26ba892f90a50496f34a2b3e63a207"
server_key_version: "encryptionkey@0"
I20260808 08:34:59.606448 16033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:34:59.634351 16033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:34:59.635392 16033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:34:59.635720 16033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:34:59.636855 16033 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:34:59.638507 16033 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:34:59.638622 16033 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:59.638754 16033 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:34:59.638862 16033 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:34:59.671464 16033 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:35427
I20260808 08:34:59.671555 16170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:35427 every 8 connection(s)
I20260808 08:34:59.672791 16033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:34:59.676292 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 16033
I20260808 08:34:59.676512 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:34:59.677363 5779 external_mini_cluster.cc:1428] Setting key 2edc11d1313bafd503f09acfbfa2ec38
I20260808 08:34:59.680531 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:41761
--builtin_ntp_servers=127.5.164.212:37587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 08:34:59.687587 16174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:59.675458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:52719 (local address 127.5.164.254:41761)
0808 08:34:59.675996 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0808 08:34:59.676004 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:34:59.677314 (+ 1310us) server_negotiation.cc:407] Connection header received
0808 08:34:59.679590 (+ 2276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:34:59.679594 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:34:59.679660 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:34:59.679750 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:34:59.681209 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:59.682159 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:59.684672 (+ 2513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:34:59.685070 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:34:59.685169 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:59.686811 (+ 1642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:34:59.686815 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:34:59.686819 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:34:59.686838 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:34:59.686876 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:34:59.686888 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:34:59.686956 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 08:34:59.687240 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 08:34:59.687319 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":246,"threads_started":1}
I20260808 08:34:59.689101 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:34:59.676022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:41761 (local address 127.5.164.193:52719)
0808 08:34:59.677118 (+ 1096us) negotiation.cc:107] Waiting for socket to connect
0808 08:34:59.677185 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 08:34:59.679292 (+ 2107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:34:59.680018 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:34:59.680030 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:34:59.680158 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:34:59.680993 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:59.681020 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:59.682317 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:59.682326 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:59.684484 (+ 2158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:34:59.684513 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:34:59.685300 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:34:59.685309 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:34:59.685645 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:34:59.686431 (+ 786us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:34:59.686437 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:34:59.686499 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:34:59.686617 (+ 118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:34:59.686988 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:34:59.687000 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:34:59.687011 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 08:34:59.687241 (+ 230us) client_negotiation.cc:240] Negotiation successful
0808 08:34:59.687671 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":317,"threads_started":1}
I20260808 08:34:59.690663 16171 heartbeater.cc:347] Connected to a master server at 127.5.164.254:41761
I20260808 08:34:59.690975 16171 heartbeater.cc:464] Registering TS with master...
I20260808 08:34:59.691800 16171 heartbeater.cc:511] Master 127.5.164.254:41761 requested a full tablet report, sending...
I20260808 08:34:59.693769 15966 ts_manager.cc:194] Registered new tserver with Master: b8e5c5a711b54fe7bb37d27a8a4fac13 (127.5.164.193:35427)
I20260808 08:34:59.695245 15966 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.164.193:52719
W20260808 08:35:00.030296 16176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:35:00.030588 16176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:35:00.030743 16176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:35:00.038365 16176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:35:00.038476 16176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:35:00.038646 16176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:35:00.047844 16176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:37587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:41761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:35:00.049256 16176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:35:00.051074 16176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:35:00.065814 16184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:00.066576 16182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:00.067119 16181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:35:00.069032 16176 server_base.cc:1034] running on GCE node
I20260808 08:35:00.069954 16176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:35:00.071190 16176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:35:00.072438 16176 hybrid_clock.cc:648] HybridClock initialized: now 1786178100072380 us; error 50 us; skew 500 ppm
I20260808 08:35:00.072781 16176 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:35:00.075073 16176 webserver.cc:460] Webserver started at http://127.5.164.194:45321/ using document root <none> and password file <none>
I20260808 08:35:00.075807 16176 fs_manager.cc:359] Metadata directory not provided
I20260808 08:35:00.075951 16176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:35:00.076295 16176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:35:00.079403 16176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "f796ea6a796a45aead482f22c5a1e433"
format_stamp: "Formatted at 2026-08-08 08:35:00 on dist-test-slave-chsk"
server_key: "9d5d6731ddea46aba7975b03f1079c9d"
server_key_iv: "55bc5cf687bc861c666df9b84bb4f5a7"
server_key_version: "encryptionkey@0"
I20260808 08:35:00.080212 16176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "f796ea6a796a45aead482f22c5a1e433"
format_stamp: "Formatted at 2026-08-08 08:35:00 on dist-test-slave-chsk"
server_key: "9d5d6731ddea46aba7975b03f1079c9d"
server_key_iv: "55bc5cf687bc861c666df9b84bb4f5a7"
server_key_version: "encryptionkey@0"
I20260808 08:35:00.085495 16176 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:35:00.088923 16191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:00.090214 16176 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:35:00.090397 16176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "f796ea6a796a45aead482f22c5a1e433"
format_stamp: "Formatted at 2026-08-08 08:35:00 on dist-test-slave-chsk"
server_key: "9d5d6731ddea46aba7975b03f1079c9d"
server_key_iv: "55bc5cf687bc861c666df9b84bb4f5a7"
server_key_version: "encryptionkey@0"
I20260808 08:35:00.090642 16176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:35:00.106076 16176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:35:00.106918 16176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:35:00.107308 16176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:35:00.108248 16176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:35:00.109687 16176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:35:00.109807 16176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:00.109949 16176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:35:00.110036 16176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:00.144455 16176 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:41069
I20260808 08:35:00.144517 16309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:41069 every 8 connection(s)
I20260808 08:35:00.145855 16176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:35:00.149045 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 16176
I20260808 08:35:00.149216 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:35:00.149904 5779 external_mini_cluster.cc:1428] Setting key b7774d1bf7c06c818dbd7129db2db6b7
I20260808 08:35:00.153350 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:41761
--builtin_ntp_servers=127.5.164.212:37587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 08:35:00.160488 16174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:00.148550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:50757 (local address 127.5.164.254:41761)
0808 08:35:00.148800 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:00.148807 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:00.150410 (+ 1603us) server_negotiation.cc:407] Connection header received
0808 08:35:00.152662 (+ 2252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:00.152666 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:00.152729 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:00.152862 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:00.154308 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:00.155021 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:00.157493 (+ 2472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:00.157894 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:00.158165 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:00.159787 (+ 1622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:00.159792 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:00.159795 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:35:00.159814 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:00.159845 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:35:00.159857 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:00.159927 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:00.160188 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 08:35:00.160267 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:35:00.161965 16315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:00.149012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:41761 (local address 127.5.164.194:50757)
0808 08:35:00.150236 (+ 1224us) negotiation.cc:107] Waiting for socket to connect
0808 08:35:00.150285 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:35:00.152375 (+ 2090us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:35:00.153138 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:35:00.153151 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:35:00.153274 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:35:00.154136 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:00.154164 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:00.155213 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:00.155221 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:00.157354 (+ 2133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:00.157372 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:00.158278 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:00.158288 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:00.158618 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:00.159436 (+ 818us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:35:00.159441 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:35:00.159494 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:35:00.159600 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:35:00.159954 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:35:00.159967 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:35:00.159977 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 08:35:00.160161 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 08:35:00.160566 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":377,"threads_started":1}
I20260808 08:35:00.163484 16313 heartbeater.cc:347] Connected to a master server at 127.5.164.254:41761
I20260808 08:35:00.163805 16313 heartbeater.cc:464] Registering TS with master...
I20260808 08:35:00.164728 16313 heartbeater.cc:511] Master 127.5.164.254:41761 requested a full tablet report, sending...
I20260808 08:35:00.166337 15966 ts_manager.cc:194] Registered new tserver with Master: f796ea6a796a45aead482f22c5a1e433 (127.5.164.194:41069)
I20260808 08:35:00.167608 15966 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.164.194:50757
W20260808 08:35:00.487860 16316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:35:00.488128 16316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:35:00.488215 16316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:35:00.495738 16316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:35:00.495838 16316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:35:00.495940 16316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:35:00.505144 16316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:37587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:41761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:35:00.506345 16316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:35:00.508167 16316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:35:00.521195 16322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:00.521152 16325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:00.521225 16323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:35:00.522194 16316 server_base.cc:1034] running on GCE node
I20260808 08:35:00.522818 16316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:35:00.523743 16316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:35:00.524967 16316 hybrid_clock.cc:648] HybridClock initialized: now 1786178100524940 us; error 58 us; skew 500 ppm
I20260808 08:35:00.525283 16316 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:35:00.527482 16316 webserver.cc:460] Webserver started at http://127.5.164.195:33393/ using document root <none> and password file <none>
I20260808 08:35:00.528151 16316 fs_manager.cc:359] Metadata directory not provided
I20260808 08:35:00.528288 16316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:35:00.528617 16316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:35:00.531424 16316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "c26471e8072f4e6f887ab7c98069f262"
format_stamp: "Formatted at 2026-08-08 08:35:00 on dist-test-slave-chsk"
server_key: "7239275885f05e875ebc9c3267bf1487"
server_key_iv: "30c9d3e60077ba3f57ed94dc4d8bb23b"
server_key_version: "encryptionkey@0"
I20260808 08:35:00.532265 16316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "c26471e8072f4e6f887ab7c98069f262"
format_stamp: "Formatted at 2026-08-08 08:35:00 on dist-test-slave-chsk"
server_key: "7239275885f05e875ebc9c3267bf1487"
server_key_iv: "30c9d3e60077ba3f57ed94dc4d8bb23b"
server_key_version: "encryptionkey@0"
I20260808 08:35:00.537669 16316 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:35:00.541077 16331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:00.542304 16316 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:35:00.542481 16316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "c26471e8072f4e6f887ab7c98069f262"
format_stamp: "Formatted at 2026-08-08 08:35:00 on dist-test-slave-chsk"
server_key: "7239275885f05e875ebc9c3267bf1487"
server_key_iv: "30c9d3e60077ba3f57ed94dc4d8bb23b"
server_key_version: "encryptionkey@0"
I20260808 08:35:00.542699 16316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:35:00.562160 16316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:35:00.563038 16316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:35:00.563385 16316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:35:00.564356 16316 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:35:00.565765 16316 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:35:00.565896 16316 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:00.566040 16316 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:35:00.566129 16316 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:00.600317 16316 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:34353
I20260808 08:35:00.600378 16448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:34353 every 8 connection(s)
I20260808 08:35:00.601809 16316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:35:00.603940 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 16316
I20260808 08:35:00.604125 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:35:00.604774 5779 external_mini_cluster.cc:1428] Setting key 58130d72afda74ad7496b6184d953ead
I20260808 08:35:00.615438 16174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:00.604638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:47469 (local address 127.5.164.254:41761)
0808 08:35:00.604824 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:00.604848 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:00.606550 (+ 1702us) server_negotiation.cc:407] Connection header received
0808 08:35:00.608827 (+ 2277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:00.608832 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:00.608901 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:00.608985 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:00.610211 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:00.610938 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:00.612602 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:00.613076 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:00.613177 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:00.614622 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:00.614627 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:00.614630 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:35:00.614650 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:00.614684 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:35:00.614696 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:00.614768 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:00.615027 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 08:35:00.615108 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:35:00.616496 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:00.605246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:41761 (local address 127.5.164.195:47469)
0808 08:35:00.606399 (+ 1153us) negotiation.cc:107] Waiting for socket to connect
0808 08:35:00.606460 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 08:35:00.608569 (+ 2109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:35:00.609189 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:35:00.609197 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:35:00.609281 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:35:00.610048 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:00.610067 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:00.611178 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:00.611186 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:00.612465 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:00.612478 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:00.613280 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:00.613284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:00.613514 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:00.614301 (+ 787us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:35:00.614304 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:35:00.614345 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:35:00.614432 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:35:00.614802 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:35:00.614811 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:35:00.614817 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 08:35:00.614979 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 08:35:00.615386 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":355,"threads_started":1}
I20260808 08:35:00.617925 16449 heartbeater.cc:347] Connected to a master server at 127.5.164.254:41761
I20260808 08:35:00.618242 16449 heartbeater.cc:464] Registering TS with master...
I20260808 08:35:00.619241 16449 heartbeater.cc:511] Master 127.5.164.254:41761 requested a full tablet report, sending...
I20260808 08:35:00.620771 15965 ts_manager.cc:194] Registered new tserver with Master: c26471e8072f4e6f887ab7c98069f262 (127.5.164.195:34353)
I20260808 08:35:00.621681 15965 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.164.195:47469
I20260808 08:35:00.633226 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 08:35:00.639703 16174 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:35:00.637939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42082 (local address 127.5.164.254:41761)
0808 08:35:00.638139 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:00.638143 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:00.638657 (+ 514us) server_negotiation.cc:407] Connection header received
0808 08:35:00.638806 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:00.638810 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:00.638885 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:00.638970 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:00.639399 (+ 429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42082: BlockingRecv error: recv got EOF from 127.0.0.1:42082 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 08:35:00.640583 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 16033
I20260808 08:35:00.648463 16461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:00.641559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41702 (local address 127.5.164.193:35427)
0808 08:35:00.642111 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:00.642118 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:00.642144 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:35:00.642200 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:00.642205 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:00.642421 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:00.642545 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:00.642900 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:00.643968 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:00.645228 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:00.645866 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:00.645966 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:00.647011 (+ 1045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:00.647020 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:00.647032 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:35:00.647721 (+ 689us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:00.647769 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:35:00.647790 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:00.647879 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:00.648052 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 08:35:00.648163 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":285,"threads_started":1}
I20260808 08:35:00.649928 16164 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:35:00.731691 16171 heartbeater.cc:503] Master 127.5.164.254:41761 was elected leader, sending a full tablet report...
I20260808 08:35:00.733174 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 16033
W20260808 08:35:00.752723 15951 connection.cc:535] server connection from 127.5.164.193:52719 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 08:35:00.753068 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 16176
I20260808 08:35:00.761139 16463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:00.754034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37620 (local address 127.5.164.194:41069)
0808 08:35:00.754556 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:00.754563 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:00.754591 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:35:00.754652 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:00.754658 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:00.754876 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:00.755005 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:00.755467 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:00.756473 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:00.757721 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:00.758369 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:00.758488 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:00.759622 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:00.759630 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:00.759645 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:35:00.760301 (+ 656us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:00.760350 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:35:00.760370 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:00.760469 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:00.760591 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 08:35:00.760728 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":245,"threads_started":1}
I20260808 08:35:00.762423 16305 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:35:00.850325 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 16176
I20260808 08:35:00.869966 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 16316
I20260808 08:35:00.878463 16465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:00.871055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39890 (local address 127.5.164.195:34353)
0808 08:35:00.871811 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:00.871818 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:00.871848 (+ 30us) server_negotiation.cc:407] Connection header received
0808 08:35:00.871910 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:00.871917 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:00.872132 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:00.872269 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:00.872715 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:00.873787 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:00.875017 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:00.875697 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:00.875804 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:00.876900 (+ 1096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:00.876908 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:00.876922 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:35:00.877592 (+ 670us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:00.877643 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:35:00.877663 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:00.877753 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:00.877886 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 08:35:00.878078 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":422,"threads_started":1}
I20260808 08:35:00.879875 16444 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:35:00.962421 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 16316
I20260808 08:35:00.980566 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 15932
I20260808 08:35:00.981848 15999 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:35:01.088546 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 15932
2026-08-08T08:35:01Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2533 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T08:35:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:35:01Z Disabled control of system clock
I20260808 08:35:01.178093 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:45951
--webserver_interface=127.5.164.254
--webserver_port=0
--builtin_ntp_servers=127.5.164.212:42789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:45951
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 08:35:01.525208 16471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:35:01.525501 16471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:35:01.525588 16471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:35:01.532704 16471 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:35:01.532810 16471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:35:01.532850 16471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:35:01.532907 16471 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:35:01.532951 16471 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:35:01.543054 16471 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:45951
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:45951
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:35:01.544379 16471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:35:01.546147 16471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:35:01.557842 16477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:01.557885 16479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:01.557919 16481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:35:01.558946 16471 server_base.cc:1034] running on GCE node
I20260808 08:35:01.559856 16471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:35:01.561357 16471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:35:01.562589 16471 hybrid_clock.cc:648] HybridClock initialized: now 1786178101562552 us; error 51 us; skew 500 ppm
I20260808 08:35:01.562937 16471 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:35:01.565326 16471 webserver.cc:460] Webserver started at http://127.5.164.254:40931/ using document root <none> and password file <none>
I20260808 08:35:01.566023 16471 fs_manager.cc:359] Metadata directory not provided
I20260808 08:35:01.566157 16471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:35:01.566527 16471 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:35:01.571197 16471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "d6dfe9b8f0794b2aa24a142517f69feb"
format_stamp: "Formatted at 2026-08-08 08:35:01 on dist-test-slave-chsk"
server_key: "a8acab32cc5cbe6b67413dc89d86fddf"
server_key_iv: "3b4af809367839acf048a8b34ef705cf"
server_key_version: "encryptionkey@0"
I20260808 08:35:01.572067 16471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "d6dfe9b8f0794b2aa24a142517f69feb"
format_stamp: "Formatted at 2026-08-08 08:35:01 on dist-test-slave-chsk"
server_key: "a8acab32cc5cbe6b67413dc89d86fddf"
server_key_iv: "3b4af809367839acf048a8b34ef705cf"
server_key_version: "encryptionkey@0"
I20260808 08:35:01.577358 16471 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:35:01.580811 16487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:01.582119 16471 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:35:01.582319 16471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "d6dfe9b8f0794b2aa24a142517f69feb"
format_stamp: "Formatted at 2026-08-08 08:35:01 on dist-test-slave-chsk"
server_key: "a8acab32cc5cbe6b67413dc89d86fddf"
server_key_iv: "3b4af809367839acf048a8b34ef705cf"
server_key_version: "encryptionkey@0"
I20260808 08:35:01.582546 16471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:35:01.588429 16471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:35:01.589205 16471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:35:01.589525 16471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:35:01.608577 16471 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:45951
I20260808 08:35:01.608615 16542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:45951 every 8 connection(s)
I20260808 08:35:01.609983 16471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:35:01.613775 16543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:35:01.615036 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 16471
I20260808 08:35:01.615304 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:35:01.616189 5779 external_mini_cluster.cc:1428] Setting key 82868118e67694414d6b17e2b7acd7f5
I20260808 08:35:01.625063 16546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:01.618507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54468 (local address 127.5.164.254:45951)
0808 08:35:01.619670 (+ 1163us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:01.619685 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:01.619732 (+ 47us) server_negotiation.cc:407] Connection header received
0808 08:35:01.621306 (+ 1574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:01.621329 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:01.621759 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:01.622151 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:01.623321 (+ 1170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:01.623327 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:01.623339 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:35:01.623356 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:01.623418 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:35:01.623435 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:01.623615 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:01.623763 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 08:35:01.624114 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":443,"threads_started":1}
I20260808 08:35:01.628108 16543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb: Bootstrap starting.
I20260808 08:35:01.631127 16543 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb: Neither blocks nor log segments found. Creating new log.
I20260808 08:35:01.632289 16543 log.cc:824] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb: Log is configured to *not* fsync() on all Append() calls
I20260808 08:35:01.635075 16543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb: No bootstrap required, opened a new log
I20260808 08:35:01.642463 16543 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6dfe9b8f0794b2aa24a142517f69feb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45951 } }
I20260808 08:35:01.642876 16543 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:35:01.642989 16543 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6dfe9b8f0794b2aa24a142517f69feb, State: Initialized, Role: FOLLOWER
I20260808 08:35:01.643613 16543 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6dfe9b8f0794b2aa24a142517f69feb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45951 } }
I20260808 08:35:01.643872 16543 raft_consensus.cc:388] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:35:01.644037 16543 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:35:01.644230 16543 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:35:01.646463 16543 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6dfe9b8f0794b2aa24a142517f69feb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45951 } }
I20260808 08:35:01.646986 16543 leader_election.cc:302] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d6dfe9b8f0794b2aa24a142517f69feb; no voters:
I20260808 08:35:01.647686 16543 leader_election.cc:288] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:35:01.647858 16548 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:35:01.648654 16548 raft_consensus.cc:686] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [term 1 LEADER]: Becoming Leader. State: Replica: d6dfe9b8f0794b2aa24a142517f69feb, State: Running, Role: LEADER
I20260808 08:35:01.649209 16548 consensus_queue.cc:237] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6dfe9b8f0794b2aa24a142517f69feb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45951 } }
I20260808 08:35:01.649962 16543 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:35:01.652104 16551 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d6dfe9b8f0794b2aa24a142517f69feb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6dfe9b8f0794b2aa24a142517f69feb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45951 } } }
I20260808 08:35:01.652741 16551 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [sys.catalog]: This master's current role is: LEADER
I20260808 08:35:01.652521 16552 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [sys.catalog]: SysCatalogTable state changed. Reason: New leader d6dfe9b8f0794b2aa24a142517f69feb. Latest consensus state: current_term: 1 leader_uuid: "d6dfe9b8f0794b2aa24a142517f69feb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d6dfe9b8f0794b2aa24a142517f69feb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45951 } } }
I20260808 08:35:01.653196 16552 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb [sys.catalog]: This master's current role is: LEADER
I20260808 08:35:01.656306 16555 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:35:01.662325 16555 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:35:01.671268 16555 catalog_manager.cc:1347] Generated new cluster ID: edb78e6b5f6d482d9ee19b22e6319989
I20260808 08:35:01.671396 16555 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:35:01.695240 16555 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:35:01.695713 16555 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:35:01.702785 16555 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d6dfe9b8f0794b2aa24a142517f69feb: Generated new TSK 0
I20260808 08:35:01.703920 16555 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:35:01.722059 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45951
--builtin_ntp_servers=127.5.164.212:42789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 08:35:02.071977 16569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:35:02.072333 16569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:35:02.072432 16569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:35:02.079938 16569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:35:02.080106 16569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:35:02.080331 16569 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:35:02.089835 16569 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45951
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:35:02.091125 16569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:35:02.093061 16569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:35:02.106087 16574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:02.106031 16575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:02.106087 16577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:35:02.107364 16569 server_base.cc:1034] running on GCE node
I20260808 08:35:02.108011 16569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:35:02.109036 16569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:35:02.110302 16569 hybrid_clock.cc:648] HybridClock initialized: now 1786178102110250 us; error 55 us; skew 500 ppm
I20260808 08:35:02.110663 16569 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:35:02.113314 16569 webserver.cc:460] Webserver started at http://127.5.164.193:37441/ using document root <none> and password file <none>
I20260808 08:35:02.114042 16569 fs_manager.cc:359] Metadata directory not provided
I20260808 08:35:02.114177 16569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:35:02.114542 16569 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:35:02.117588 16569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "dc6dfaf1d1b74c5c80f41391a30d43df"
format_stamp: "Formatted at 2026-08-08 08:35:02 on dist-test-slave-chsk"
server_key: "ee4e793006eecb64e0d76720670cfbb7"
server_key_iv: "9421aad0c4b18a0991c9e99496ac59ae"
server_key_version: "encryptionkey@0"
I20260808 08:35:02.118425 16569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "dc6dfaf1d1b74c5c80f41391a30d43df"
format_stamp: "Formatted at 2026-08-08 08:35:02 on dist-test-slave-chsk"
server_key: "ee4e793006eecb64e0d76720670cfbb7"
server_key_iv: "9421aad0c4b18a0991c9e99496ac59ae"
server_key_version: "encryptionkey@0"
I20260808 08:35:02.123814 16569 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 08:35:02.127306 16583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:02.128640 16569 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:35:02.128827 16569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "dc6dfaf1d1b74c5c80f41391a30d43df"
format_stamp: "Formatted at 2026-08-08 08:35:02 on dist-test-slave-chsk"
server_key: "ee4e793006eecb64e0d76720670cfbb7"
server_key_iv: "9421aad0c4b18a0991c9e99496ac59ae"
server_key_version: "encryptionkey@0"
I20260808 08:35:02.129060 16569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:35:02.134955 16569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:35:02.135872 16569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:35:02.136157 16569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:35:02.137188 16569 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:35:02.138612 16569 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:35:02.138748 16569 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:02.138872 16569 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:35:02.138959 16569 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:02.173592 16569 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:40493
I20260808 08:35:02.173650 16706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:40493 every 8 connection(s)
I20260808 08:35:02.174943 16569 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:35:02.182960 16709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:02.177595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:42033 (local address 127.5.164.254:45951)
0808 08:35:02.178056 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:02.178061 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:02.179266 (+ 1205us) server_negotiation.cc:407] Connection header received
0808 08:35:02.180876 (+ 1610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:02.180880 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:02.180933 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:02.181034 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:02.182291 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:02.182296 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:02.182299 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:35:02.182316 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:02.182363 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:35:02.182376 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:02.182489 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:02.182653 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 08:35:02.182705 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":237,"threads_started":1}
I20260808 08:35:02.183806 16710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:02.178168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:45951 (local address 127.5.164.193:42033)
0808 08:35:02.179054 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0808 08:35:02.179089 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 08:35:02.180648 (+ 1559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:35:02.181229 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:35:02.181236 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:35:02.181320 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:35:02.181961 (+ 641us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:35:02.181964 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:35:02.182011 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:35:02.182091 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:35:02.182470 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:35:02.182479 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:35:02.182484 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:35:02.182690 (+ 206us) client_negotiation.cc:240] Negotiation successful
0808 08:35:02.182866 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":266,"threads_started":1}
I20260808 08:35:02.184491 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 16569
I20260808 08:35:02.184720 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:35:02.185461 16707 heartbeater.cc:347] Connected to a master server at 127.5.164.254:45951
I20260808 08:35:02.185570 5779 external_mini_cluster.cc:1428] Setting key c464531a2cc4e14ecafd4d0a4d26d19d
I20260808 08:35:02.185765 16707 heartbeater.cc:464] Registering TS with master...
I20260808 08:35:02.186501 16707 heartbeater.cc:511] Master 127.5.164.254:45951 requested a full tablet report, sending...
I20260808 08:35:02.188377 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45951
--builtin_ntp_servers=127.5.164.212:42789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 08:35:02.188468 16505 ts_manager.cc:194] Registered new tserver with Master: dc6dfaf1d1b74c5c80f41391a30d43df (127.5.164.193:40493)
W20260808 08:35:02.522886 16711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:35:02.523262 16711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:35:02.523375 16711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:35:02.530572 16711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:35:02.530676 16711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:35:02.530786 16711 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:35:02.540282 16711 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45951
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:35:02.541579 16711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:35:02.543432 16711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:35:02.556968 16716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:02.556938 16717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:02.557245 16719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:35:02.557785 16711 server_base.cc:1034] running on GCE node
I20260808 08:35:02.558437 16711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:35:02.559494 16711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:35:02.560730 16711 hybrid_clock.cc:648] HybridClock initialized: now 1786178102560690 us; error 55 us; skew 500 ppm
I20260808 08:35:02.561072 16711 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:35:02.569020 16711 webserver.cc:460] Webserver started at http://127.5.164.194:45401/ using document root <none> and password file <none>
I20260808 08:35:02.569872 16711 fs_manager.cc:359] Metadata directory not provided
I20260808 08:35:02.570039 16711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:35:02.570425 16711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:35:02.573769 16711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "53c60403bbdc4ec48d723a53ce5793aa"
format_stamp: "Formatted at 2026-08-08 08:35:02 on dist-test-slave-chsk"
server_key: "ca85e1acae6090ec7bed4e0f4470bb2c"
server_key_iv: "18ba18eff38de2fc9c59dd6ae2867f84"
server_key_version: "encryptionkey@0"
I20260808 08:35:02.574801 16711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "53c60403bbdc4ec48d723a53ce5793aa"
format_stamp: "Formatted at 2026-08-08 08:35:02 on dist-test-slave-chsk"
server_key: "ca85e1acae6090ec7bed4e0f4470bb2c"
server_key_iv: "18ba18eff38de2fc9c59dd6ae2867f84"
server_key_version: "encryptionkey@0"
I20260808 08:35:02.580561 16711 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 08:35:02.584249 16726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:02.585703 16711 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:35:02.585894 16711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "53c60403bbdc4ec48d723a53ce5793aa"
format_stamp: "Formatted at 2026-08-08 08:35:02 on dist-test-slave-chsk"
server_key: "ca85e1acae6090ec7bed4e0f4470bb2c"
server_key_iv: "18ba18eff38de2fc9c59dd6ae2867f84"
server_key_version: "encryptionkey@0"
I20260808 08:35:02.586149 16711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:35:02.592272 16711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:35:02.593142 16711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:35:02.593441 16711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:35:02.594403 16711 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:35:02.596109 16711 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:35:02.596253 16711 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:02.596386 16711 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:35:02.596477 16711 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:02.631399 16711 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:45939
I20260808 08:35:02.633277 16711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:35:02.631439 16850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:45939 every 8 connection(s)
I20260808 08:35:02.638222 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 16711
I20260808 08:35:02.638437 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:35:02.639029 5779 external_mini_cluster.cc:1428] Setting key e0afcb86844abac651c764256e5a9106
I20260808 08:35:02.641904 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45951
--builtin_ntp_servers=127.5.164.212:42789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 08:35:02.642648 16709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:02.636268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:45731 (local address 127.5.164.254:45951)
0808 08:35:02.636446 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:02.636451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:02.638444 (+ 1993us) server_negotiation.cc:407] Connection header received
0808 08:35:02.640193 (+ 1749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:02.640199 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:02.640278 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:02.640404 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:02.641784 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:02.641790 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:02.641794 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:35:02.641819 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:02.641851 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:35:02.641863 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:02.642001 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:02.642289 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 08:35:02.642364 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:35:02.643693 16853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:02.636737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:45951 (local address 127.5.164.194:45731)
0808 08:35:02.637648 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0808 08:35:02.637684 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 08:35:02.639914 (+ 2230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:35:02.640646 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:35:02.640655 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:35:02.640748 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:35:02.641462 (+ 714us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:35:02.641464 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:35:02.641503 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:35:02.641590 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:35:02.641967 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:35:02.641978 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:35:02.641997 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 08:35:02.642379 (+ 382us) client_negotiation.cc:240] Negotiation successful
0808 08:35:02.642650 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":279,"threads_started":1}
I20260808 08:35:02.645188 16851 heartbeater.cc:347] Connected to a master server at 127.5.164.254:45951
I20260808 08:35:02.645501 16851 heartbeater.cc:464] Registering TS with master...
I20260808 08:35:02.646080 16851 heartbeater.cc:511] Master 127.5.164.254:45951 requested a full tablet report, sending...
I20260808 08:35:02.647554 16505 ts_manager.cc:194] Registered new tserver with Master: 53c60403bbdc4ec48d723a53ce5793aa (127.5.164.194:45939)
W20260808 08:35:02.990262 16854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:35:02.990543 16854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:35:02.990744 16854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:35:02.998198 16854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:35:02.998307 16854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:35:02.998497 16854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:35:03.008364 16854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45951
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:35:03.009689 16854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:35:03.011574 16854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:35:03.024654 16859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:03.024682 16860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:03.024724 16862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:35:03.025489 16854 server_base.cc:1034] running on GCE node
I20260808 08:35:03.026063 16854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:35:03.027027 16854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:35:03.028213 16854 hybrid_clock.cc:648] HybridClock initialized: now 1786178103028167 us; error 49 us; skew 500 ppm
I20260808 08:35:03.028538 16854 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:35:03.030800 16854 webserver.cc:460] Webserver started at http://127.5.164.195:35109/ using document root <none> and password file <none>
I20260808 08:35:03.031561 16854 fs_manager.cc:359] Metadata directory not provided
I20260808 08:35:03.031679 16854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:35:03.032038 16854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:35:03.035002 16854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "cdcbb5b7d5ea4a8290de6c29d50c4b85"
format_stamp: "Formatted at 2026-08-08 08:35:03 on dist-test-slave-chsk"
server_key: "2681d5ef7ea9810e146bcaa3ba8c2ed8"
server_key_iv: "f1dce212c5beca87ec1ce39a2614d52b"
server_key_version: "encryptionkey@0"
I20260808 08:35:03.035893 16854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "cdcbb5b7d5ea4a8290de6c29d50c4b85"
format_stamp: "Formatted at 2026-08-08 08:35:03 on dist-test-slave-chsk"
server_key: "2681d5ef7ea9810e146bcaa3ba8c2ed8"
server_key_iv: "f1dce212c5beca87ec1ce39a2614d52b"
server_key_version: "encryptionkey@0"
I20260808 08:35:03.041009 16854 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:35:03.044549 16869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:03.045885 16854 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:35:03.046065 16854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "cdcbb5b7d5ea4a8290de6c29d50c4b85"
format_stamp: "Formatted at 2026-08-08 08:35:03 on dist-test-slave-chsk"
server_key: "2681d5ef7ea9810e146bcaa3ba8c2ed8"
server_key_iv: "f1dce212c5beca87ec1ce39a2614d52b"
server_key_version: "encryptionkey@0"
I20260808 08:35:03.046308 16854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:35:03.052312 16854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:35:03.053128 16854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:35:03.053419 16854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:35:03.054342 16854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:35:03.055811 16854 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:35:03.055933 16854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:03.056072 16854 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:35:03.056160 16854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:03.092696 16854 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:44735
I20260808 08:35:03.092763 16990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:44735 every 8 connection(s)
I20260808 08:35:03.094091 16854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:35:03.102504 16709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:03.096840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:38141 (local address 127.5.164.254:45951)
0808 08:35:03.097015 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:03.097020 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:03.098409 (+ 1389us) server_negotiation.cc:407] Connection header received
0808 08:35:03.100213 (+ 1804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:03.100218 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:03.100277 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:03.100371 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:03.101641 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:03.101645 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:03.101649 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:35:03.101666 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:03.101702 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:35:03.101715 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:03.101814 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:03.102164 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 08:35:03.102230 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:35:03.102909 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 16854
I20260808 08:35:03.103112 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:35:03.103753 5779 external_mini_cluster.cc:1428] Setting key 0cabffc55483ab243e41e08990a604f2
I20260808 08:35:03.103752 16994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:03.097310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:45951 (local address 127.5.164.195:38141)
0808 08:35:03.098240 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0808 08:35:03.098284 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 08:35:03.099937 (+ 1653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:35:03.100581 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:35:03.100590 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:35:03.100682 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:35:03.101343 (+ 661us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:35:03.101346 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:35:03.101383 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:35:03.101467 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:35:03.101892 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:35:03.101906 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:35:03.101918 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 08:35:03.102257 (+ 339us) client_negotiation.cc:240] Negotiation successful
0808 08:35:03.102508 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":295,"threads_started":1}
I20260808 08:35:03.105355 16991 heartbeater.cc:347] Connected to a master server at 127.5.164.254:45951
I20260808 08:35:03.105728 16991 heartbeater.cc:464] Registering TS with master...
I20260808 08:35:03.106386 16991 heartbeater.cc:511] Master 127.5.164.254:45951 requested a full tablet report, sending...
I20260808 08:35:03.107923 16504 ts_manager.cc:194] Registered new tserver with Master: cdcbb5b7d5ea4a8290de6c29d50c4b85 (127.5.164.195:44735)
I20260808 08:35:03.119750 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 08:35:03.126652 16709 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:35:03.124838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54482 (local address 127.5.164.254:45951)
0808 08:35:03.125183 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:03.125192 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:03.125704 (+ 512us) server_negotiation.cc:407] Connection header received
0808 08:35:03.125875 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:03.125879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:03.125935 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:03.126024 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:03.126349 (+ 325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54482: BlockingRecv error: recv got EOF from 127.0.0.1:54482 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 08:35:03.127364 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 16569
I20260808 08:35:03.131261 17001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:03.128466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60182 (local address 127.5.164.193:40493)
0808 08:35:03.129043 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:03.129058 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:03.129084 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:35:03.129144 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:03.129149 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:03.129369 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:03.129496 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:03.130447 (+ 951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:03.130455 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:03.130471 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:35:03.130502 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:03.130545 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:35:03.130560 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:03.130717 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:03.130810 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 08:35:03.130914 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":301,"threads_started":1}
I20260808 08:35:03.132488 16702 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:35:03.213230 16707 heartbeater.cc:503] Master 127.5.164.254:45951 was elected leader, sending a full tablet report...
I20260808 08:35:03.215502 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 16569
I20260808 08:35:03.235707 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 16711
I20260808 08:35:03.239511 17003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:03.236777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44680 (local address 127.5.164.194:45939)
0808 08:35:03.237289 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:03.237296 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:03.237324 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:35:03.237386 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:03.237392 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:03.237615 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:03.237751 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:03.238699 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:03.238705 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:03.238716 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:35:03.238730 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:03.238779 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:35:03.238797 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:03.238908 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:03.239065 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 08:35:03.239221 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":234,"threads_started":1}
I20260808 08:35:03.240773 16846 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:35:03.322860 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 16711
I20260808 08:35:03.341868 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 16854
I20260808 08:35:03.345935 17005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:03.342925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37472 (local address 127.5.164.195:44735)
0808 08:35:03.343648 (+ 723us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:03.343654 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:03.343684 (+ 30us) server_negotiation.cc:407] Connection header received
0808 08:35:03.343744 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:03.343751 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:03.343967 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:03.344107 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:03.345131 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:03.345137 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:03.345148 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:35:03.345164 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:03.345204 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:35:03.345217 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:03.345352 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:03.345462 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 08:35:03.345568 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":390,"threads_started":1}
I20260808 08:35:03.347426 16985 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:35:03.429951 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 16854
I20260808 08:35:03.449594 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 16471
I20260808 08:35:03.451115 16538 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:35:03.555521 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 16471
2026-08-08T08:35:03Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2466 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:35:03 dist-test-slave-chsk krb5kdc[17010](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:35:03 dist-test-slave-chsk krb5kdc[17010](info): set up 2 sockets
Aug 08 08:35:03 dist-test-slave-chsk krb5kdc[17010](info): commencing operation
krb5kdc: starting...
W20260808 08:35:04.713032 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:35:04 dist-test-slave-chsk krb5kdc[17010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:35:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:35:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:35:05.008538 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:39717
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:41887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:39717
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:35:05.354566 17024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:35:05.354853 17024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:35:05.354974 17024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:35:05.362251 17024 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:35:05.362362 17024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:35:05.362502 17024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:35:05.362604 17024 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:35:05.362689 17024 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:35:05.373272 17024 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:41887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:39717
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:39717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:35:05.374608 17024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:35:05.376008 17024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:35:05.388092 17029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:05.388262 17032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:05.388257 17030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:35:05.388993 17024 server_base.cc:1034] running on GCE node
I20260808 08:35:05.389842 17024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:35:05.391266 17024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:35:05.392498 17024 hybrid_clock.cc:648] HybridClock initialized: now 1786178105392454 us; error 51 us; skew 500 ppm
I20260808 08:35:05.392858 17024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:35:05 dist-test-slave-chsk krb5kdc[17010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178105, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:35:05.399308 17024 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:35:05.400889 17024 webserver.cc:460] Webserver started at http://127.5.164.254:39555/ using document root <none> and password file <none>
I20260808 08:35:05.401590 17024 fs_manager.cc:359] Metadata directory not provided
I20260808 08:35:05.401746 17024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:35:05.402076 17024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:35:05.405167 17024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "fd64e8d77abc4d86a3a0a8beb251fefd"
format_stamp: "Formatted at 2026-08-08 08:35:05 on dist-test-slave-chsk"
server_key: "abfb6359936fd66121c11d31073159fa"
server_key_iv: "54082004c1fdc7cf125525f6e34bf1a0"
server_key_version: "encryptionkey@0"
I20260808 08:35:05.405982 17024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "fd64e8d77abc4d86a3a0a8beb251fefd"
format_stamp: "Formatted at 2026-08-08 08:35:05 on dist-test-slave-chsk"
server_key: "abfb6359936fd66121c11d31073159fa"
server_key_iv: "54082004c1fdc7cf125525f6e34bf1a0"
server_key_version: "encryptionkey@0"
I20260808 08:35:05.411412 17024 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260808 08:35:05.415030 17040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:05.416450 17024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:35:05.416641 17024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "fd64e8d77abc4d86a3a0a8beb251fefd"
format_stamp: "Formatted at 2026-08-08 08:35:05 on dist-test-slave-chsk"
server_key: "abfb6359936fd66121c11d31073159fa"
server_key_iv: "54082004c1fdc7cf125525f6e34bf1a0"
server_key_version: "encryptionkey@0"
I20260808 08:35:05.416850 17024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:35:05.432565 17024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:35:05.436623 17024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:35:05.436961 17024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:35:05.456209 17024 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:39717
I20260808 08:35:05.456252 17093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:39717 every 8 connection(s)
I20260808 08:35:05.457666 17024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:35:05.459033 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 17024
I20260808 08:35:05.459378 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:35:05.460039 5779 external_mini_cluster.cc:1428] Setting key 81d14973b945fc4b0beb371b2d1b73d0
I20260808 08:35:05.461802 17094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:35:05 dist-test-slave-chsk krb5kdc[17010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:35:05.475462 17094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd: Bootstrap starting.
I20260808 08:35:05.479564 17094 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd: Neither blocks nor log segments found. Creating new log.
I20260808 08:35:05.480825 17094 log.cc:824] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd: Log is configured to *not* fsync() on all Append() calls
I20260808 08:35:05.484302 17094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd: No bootstrap required, opened a new log
I20260808 08:35:05.484584 17097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:05.462013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56668 (local address 127.5.164.254:39717)
0808 08:35:05.462846 (+ 833us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:05.462861 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:05.462911 (+ 50us) server_negotiation.cc:407] Connection header received
0808 08:35:05.465006 (+ 2095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:05.465035 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:05.465548 (+ 513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:05.465985 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:05.467468 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:05.469533 (+ 2065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:05.470856 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:05.471930 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:05.472125 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:05.476153 (+ 4028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:05.476164 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:05.476180 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:35:05.476238 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:05.480260 (+ 4022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:05.480931 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:05.480940 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:05.480949 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:05.481169 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:05.481640 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:05.481644 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:05.481646 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:05.482139 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:05.482472 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:05.482831 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 08:35:05.483283 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":330,"threads_started":1}
I20260808 08:35:05.492668 17094 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd64e8d77abc4d86a3a0a8beb251fefd" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39717 } }
I20260808 08:35:05.493100 17094 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:35:05.493177 17094 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd64e8d77abc4d86a3a0a8beb251fefd, State: Initialized, Role: FOLLOWER
I20260808 08:35:05.493646 17094 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd64e8d77abc4d86a3a0a8beb251fefd" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39717 } }
I20260808 08:35:05.493865 17094 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:35:05.493959 17094 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:35:05.494079 17094 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:35:05.496232 17094 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd64e8d77abc4d86a3a0a8beb251fefd" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39717 } }
I20260808 08:35:05.496649 17094 leader_election.cc:302] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd64e8d77abc4d86a3a0a8beb251fefd; no voters:
I20260808 08:35:05.497264 17094 leader_election.cc:288] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:35:05.497352 17099 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:35:05.498119 17099 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [term 1 LEADER]: Becoming Leader. State: Replica: fd64e8d77abc4d86a3a0a8beb251fefd, State: Running, Role: LEADER
I20260808 08:35:05.498617 17099 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd64e8d77abc4d86a3a0a8beb251fefd" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39717 } }
I20260808 08:35:05.499414 17094 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:35:05.501423 17101 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd64e8d77abc4d86a3a0a8beb251fefd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd64e8d77abc4d86a3a0a8beb251fefd" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39717 } } }
I20260808 08:35:05.501586 17102 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd64e8d77abc4d86a3a0a8beb251fefd. Latest consensus state: current_term: 1 leader_uuid: "fd64e8d77abc4d86a3a0a8beb251fefd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd64e8d77abc4d86a3a0a8beb251fefd" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39717 } } }
I20260808 08:35:05.501936 17101 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [sys.catalog]: This master's current role is: LEADER
I20260808 08:35:05.502000 17102 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd [sys.catalog]: This master's current role is: LEADER
I20260808 08:35:05.502902 17105 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:35:05.509879 17105 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:35:05.519037 17105 catalog_manager.cc:1347] Generated new cluster ID: a1ffb8a30e4749e0be611024b5d8a2cc
I20260808 08:35:05.519191 17105 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:35:05.532742 17105 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:35:05.533995 17105 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:35:05.541823 17105 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd: Generated new TSK 0
I20260808 08:35:05.542609 17105 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:35:05.619640 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39717
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:41887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:35:06.002349 17125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:35:06.002628 17125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:35:06.002734 17125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:35:06.010175 17125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:35:06.010290 17125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:35:06.010416 17125 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:35:06.020265 17125 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:41887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39717
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:35:06.021703 17125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:35:06.023036 17125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:35:06.036751 17131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:06.036834 17132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:06.036857 17134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:35:06.038322 17125 server_base.cc:1034] running on GCE node
I20260808 08:35:06.039036 17125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:35:06.040081 17125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:35:06.041317 17125 hybrid_clock.cc:648] HybridClock initialized: now 1786178106041283 us; error 58 us; skew 500 ppm
I20260808 08:35:06.041651 17125 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:35:06 dist-test-slave-chsk krb5kdc[17010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178106, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:35:06.045029 17125 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:35:06.046553 17125 webserver.cc:460] Webserver started at http://127.5.164.193:38885/ using document root <none> and password file <none>
I20260808 08:35:06.047331 17125 fs_manager.cc:359] Metadata directory not provided
I20260808 08:35:06.047500 17125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:35:06.047827 17125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:35:06.050760 17125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "ffc7dbf4db1a4f039722a46004e0c323"
format_stamp: "Formatted at 2026-08-08 08:35:06 on dist-test-slave-chsk"
server_key: "4a93c276c9f4d31a6d56eae7870bc47c"
server_key_iv: "9797409790cac96a22e28574ed8a3301"
server_key_version: "encryptionkey@0"
I20260808 08:35:06.051616 17125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "ffc7dbf4db1a4f039722a46004e0c323"
format_stamp: "Formatted at 2026-08-08 08:35:06 on dist-test-slave-chsk"
server_key: "4a93c276c9f4d31a6d56eae7870bc47c"
server_key_iv: "9797409790cac96a22e28574ed8a3301"
server_key_version: "encryptionkey@0"
I20260808 08:35:06.057035 17125 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:35:06.060482 17141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:06.061723 17125 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:35:06.061900 17125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "ffc7dbf4db1a4f039722a46004e0c323"
format_stamp: "Formatted at 2026-08-08 08:35:06 on dist-test-slave-chsk"
server_key: "4a93c276c9f4d31a6d56eae7870bc47c"
server_key_iv: "9797409790cac96a22e28574ed8a3301"
server_key_version: "encryptionkey@0"
I20260808 08:35:06.062317 17125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:35:06.088277 17125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:35:06.092849 17125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:35:06.093205 17125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:35:06.094192 17125 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:35:06.095580 17125 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:35:06.095690 17125 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:06.095844 17125 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:35:06.095919 17125 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:06.131299 17125 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:37675
I20260808 08:35:06.131338 17260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:37675 every 8 connection(s)
I20260808 08:35:06.132622 17125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:35:06.135782 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 17125
I20260808 08:35:06.136040 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:35:06.136729 5779 external_mini_cluster.cc:1428] Setting key 60b9e85ce3def930477cc0cdad21ee56
Aug 08 08:35:06 dist-test-slave-chsk krb5kdc[17010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178106, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:35:06.154413 17264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:06.135290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:56853 (local address 127.5.164.254:39717)
0808 08:35:06.135825 (+ 535us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:06.135832 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:06.137110 (+ 1278us) server_negotiation.cc:407] Connection header received
0808 08:35:06.138958 (+ 1848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:06.138964 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:06.139054 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:06.139187 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:06.140632 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:06.141338 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:06.142879 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:06.143335 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:06.143466 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:06.147518 (+ 4052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:06.147526 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:06.147534 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:35:06.147576 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:06.151053 (+ 3477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:06.152085 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:06.152089 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:06.152091 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:06.152216 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:06.152722 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:06.152725 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:06.152727 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:06.152982 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:06.153110 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:06.153994 (+ 884us) server_negotiation.cc:299] Negotiation successful
0808 08:35:06.154167 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":248,"threads_started":1}
I20260808 08:35:06.156069 17265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:06.135808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39717 (local address 127.5.164.193:56853)
0808 08:35:06.136688 (+ 880us) negotiation.cc:107] Waiting for socket to connect
0808 08:35:06.136741 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:35:06.138678 (+ 1937us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:35:06.139428 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:35:06.139436 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:35:06.139926 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:35:06.140465 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:06.140481 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:06.141515 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:06.141519 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:06.142725 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:06.142742 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:06.143569 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:06.143577 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:06.143800 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:06.144502 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:35:06.144523 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:35:06.147279 (+ 2756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:35:06.151245 (+ 3966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:35:06.151257 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:35:06.151276 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:35:06.151950 (+ 674us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:35:06.152341 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:35:06.152349 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:35:06.152356 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:35:06.152605 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:35:06.153121 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:35:06.153132 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:35:06.153591 (+ 459us) client_negotiation.cc:769] Sending connection context
0808 08:35:06.153900 (+ 309us) client_negotiation.cc:240] Negotiation successful
0808 08:35:06.154549 (+ 649us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"thread_start_us":395,"threads_started":1}
I20260808 08:35:06.157744 17262 heartbeater.cc:347] Connected to a master server at 127.5.164.254:39717
I20260808 08:35:06.158051 17262 heartbeater.cc:464] Registering TS with master...
I20260808 08:35:06.158780 17262 heartbeater.cc:511] Master 127.5.164.254:39717 requested a full tablet report, sending...
I20260808 08:35:06.161207 17058 ts_manager.cc:194] Registered new tserver with Master: ffc7dbf4db1a4f039722a46004e0c323 (127.5.164.193:37675)
I20260808 08:35:06.163473 17058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:56853
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:35:06.205955 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39717
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:41887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:35:06.548686 17268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:35:06.548959 17268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:35:06.549162 17268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:35:06.556195 17268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:35:06.556329 17268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:35:06.556524 17268 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:35:06.566318 17268 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:41887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39717
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:35:06.567787 17268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:35:06.569130 17268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:35:06.582818 17276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:06.582880 17274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:06.582918 17273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:35:06.583700 17268 server_base.cc:1034] running on GCE node
I20260808 08:35:06.584282 17268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:35:06.585418 17268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:35:06.586627 17268 hybrid_clock.cc:648] HybridClock initialized: now 1786178106586580 us; error 45 us; skew 500 ppm
I20260808 08:35:06.586961 17268 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:35:06 dist-test-slave-chsk krb5kdc[17010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178106, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:35:06.590227 17268 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:35:06.591856 17268 webserver.cc:460] Webserver started at http://127.5.164.194:44093/ using document root <none> and password file <none>
I20260808 08:35:06.592551 17268 fs_manager.cc:359] Metadata directory not provided
I20260808 08:35:06.592705 17268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:35:06.593019 17268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:35:06.596002 17268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "3a4a77b064a146a182e1cd4e0930793e"
format_stamp: "Formatted at 2026-08-08 08:35:06 on dist-test-slave-chsk"
server_key: "ba0e5cce2b475baf52ccc23602a7bbd0"
server_key_iv: "808f0f6c8394f96946a35c61eaf05386"
server_key_version: "encryptionkey@0"
I20260808 08:35:06.596792 17268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "3a4a77b064a146a182e1cd4e0930793e"
format_stamp: "Formatted at 2026-08-08 08:35:06 on dist-test-slave-chsk"
server_key: "ba0e5cce2b475baf52ccc23602a7bbd0"
server_key_iv: "808f0f6c8394f96946a35c61eaf05386"
server_key_version: "encryptionkey@0"
I20260808 08:35:06.602021 17268 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 08:35:06.605626 17284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:06.606967 17268 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:35:06.607203 17268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "3a4a77b064a146a182e1cd4e0930793e"
format_stamp: "Formatted at 2026-08-08 08:35:06 on dist-test-slave-chsk"
server_key: "ba0e5cce2b475baf52ccc23602a7bbd0"
server_key_iv: "808f0f6c8394f96946a35c61eaf05386"
server_key_version: "encryptionkey@0"
I20260808 08:35:06.607424 17268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:35:06.634358 17268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:35:06.638521 17268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:35:06.638850 17268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:35:06.639935 17268 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:35:06.641310 17268 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:35:06.641420 17268 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:06.641566 17268 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:35:06.641640 17268 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:06.675729 17268 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:46665
I20260808 08:35:06.675791 17400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:46665 every 8 connection(s)
I20260808 08:35:06.677021 17268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:35:06.686431 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 17268
I20260808 08:35:06.686641 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:35:06.687119 5779 external_mini_cluster.cc:1428] Setting key 902476e4016d718578e6e81c288d91fa
Aug 08 08:35:06 dist-test-slave-chsk krb5kdc[17010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178106, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:35:06.697418 17403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:06.679739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:55859 (local address 127.5.164.254:39717)
0808 08:35:06.680196 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:06.680200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:06.681190 (+ 990us) server_negotiation.cc:407] Connection header received
0808 08:35:06.683025 (+ 1835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:06.683030 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:06.683123 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:06.683300 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:06.684767 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:06.685519 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:06.687216 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:06.687717 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:06.687860 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:06.691523 (+ 3663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:06.691528 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:06.691531 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:35:06.691563 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:06.694139 (+ 2576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:06.694948 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:06.694955 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:06.694958 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:06.695095 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:06.695620 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:06.695628 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:06.695634 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:06.695914 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:06.696070 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:06.696763 (+ 693us) server_negotiation.cc:299] Negotiation successful
0808 08:35:06.696983 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":248,"threads_started":1}
I20260808 08:35:06.698403 17404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:06.680318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39717 (local address 127.5.164.194:55859)
0808 08:35:06.681029 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0808 08:35:06.681075 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 08:35:06.682759 (+ 1684us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:35:06.683541 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:35:06.683549 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:35:06.684053 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:35:06.684590 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:06.684606 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:06.685691 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:06.685694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:06.687039 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:06.687056 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:06.687963 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:06.687972 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:06.688280 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:06.689009 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:35:06.689032 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:35:06.691294 (+ 2262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:35:06.694325 (+ 3031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:35:06.694335 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:35:06.694351 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:35:06.694826 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:35:06.695239 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:35:06.695246 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:35:06.695269 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:35:06.695479 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:35:06.696060 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:35:06.696067 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:35:06.696395 (+ 328us) client_negotiation.cc:769] Sending connection context
0808 08:35:06.696669 (+ 274us) client_negotiation.cc:240] Negotiation successful
0808 08:35:06.697210 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":289,"threads_started":1}
I20260808 08:35:06.700053 17401 heartbeater.cc:347] Connected to a master server at 127.5.164.254:39717
I20260808 08:35:06.700363 17401 heartbeater.cc:464] Registering TS with master...
I20260808 08:35:06.701116 17401 heartbeater.cc:511] Master 127.5.164.254:39717 requested a full tablet report, sending...
I20260808 08:35:06.702692 17058 ts_manager.cc:194] Registered new tserver with Master: 3a4a77b064a146a182e1cd4e0930793e (127.5.164.194:46665)
I20260808 08:35:06.703574 17058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:55859
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:35:06.752429 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39717
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:41887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:35:07.091306 17409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:35:07.091598 17409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:35:07.091696 17409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:35:07.099076 17409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:35:07.099267 17409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:35:07.099452 17409 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:35:07.109725 17409 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:41887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:39717
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:35:07.111222 17409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:35:07.112601 17409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:35:07.125958 17414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:07.125932 17415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:07.125996 17418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:35:07.127012 17409 server_base.cc:1034] running on GCE node
I20260808 08:35:07.127694 17409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:35:07.128670 17409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:35:07.129907 17409 hybrid_clock.cc:648] HybridClock initialized: now 1786178107129854 us; error 51 us; skew 500 ppm
I20260808 08:35:07.130252 17409 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:35:07 dist-test-slave-chsk krb5kdc[17010](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178107, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:35:07.133550 17409 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:35:07.135229 17409 webserver.cc:460] Webserver started at http://127.5.164.195:40531/ using document root <none> and password file <none>
I20260808 08:35:07.135915 17409 fs_manager.cc:359] Metadata directory not provided
I20260808 08:35:07.136046 17409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:35:07.136355 17409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:35:07.139380 17409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "4d60c4dee51a40aeb5232a32bec7b781"
format_stamp: "Formatted at 2026-08-08 08:35:07 on dist-test-slave-chsk"
server_key: "b83861ad25b2d25ac4cd1ac12402a506"
server_key_iv: "d1553e98245fcee9767d732f0be8f946"
server_key_version: "encryptionkey@0"
I20260808 08:35:07.140197 17409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "4d60c4dee51a40aeb5232a32bec7b781"
format_stamp: "Formatted at 2026-08-08 08:35:07 on dist-test-slave-chsk"
server_key: "b83861ad25b2d25ac4cd1ac12402a506"
server_key_iv: "d1553e98245fcee9767d732f0be8f946"
server_key_version: "encryptionkey@0"
I20260808 08:35:07.145542 17409 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260808 08:35:07.148998 17425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:07.150336 17409 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:35:07.150518 17409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "4d60c4dee51a40aeb5232a32bec7b781"
format_stamp: "Formatted at 2026-08-08 08:35:07 on dist-test-slave-chsk"
server_key: "b83861ad25b2d25ac4cd1ac12402a506"
server_key_iv: "d1553e98245fcee9767d732f0be8f946"
server_key_version: "encryptionkey@0"
I20260808 08:35:07.150722 17409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:35:07.166720 17262 heartbeater.cc:503] Master 127.5.164.254:39717 was elected leader, sending a full tablet report...
I20260808 08:35:07.172837 17409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:35:07.177601 17409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:35:07.177927 17409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:35:07.178996 17409 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:35:07.180440 17409 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:35:07.180555 17409 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:07.180719 17409 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:35:07.180796 17409 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:07.217657 17409 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:35609
I20260808 08:35:07.217708 17545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:35609 every 8 connection(s)
I20260808 08:35:07.219044 17409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:35:07.222289 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 17409
I20260808 08:35:07.222508 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:35:07.222963 5779 external_mini_cluster.cc:1428] Setting key 92124b870f98f870eee730eb0e288f2c
Aug 08 08:35:07 dist-test-slave-chsk krb5kdc[17010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178107, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:35:07.240913 17549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.221856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:50431 (local address 127.5.164.254:39717)
0808 08:35:07.222435 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:07.222442 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:07.223732 (+ 1290us) server_negotiation.cc:407] Connection header received
0808 08:35:07.226273 (+ 2541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:07.226279 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:07.226382 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:07.226467 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:07.228045 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.228869 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.230417 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.230824 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.230918 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.234610 (+ 3692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:07.234615 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:07.234619 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:35:07.234655 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:07.237695 (+ 3040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:07.238663 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:07.238668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:07.238672 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:07.238837 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:07.239347 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:07.239351 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:07.239353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:07.239628 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:07.239752 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:07.240456 (+ 704us) server_negotiation.cc:299] Negotiation successful
0808 08:35:07.240628 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":282,"threads_started":1}
I20260808 08:35:07.241904 17550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.222580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39717 (local address 127.5.164.195:50431)
0808 08:35:07.223523 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0808 08:35:07.223580 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:35:07.225947 (+ 2367us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:35:07.226680 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:35:07.226689 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:35:07.227293 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:35:07.227890 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:07.227907 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.229011 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.229015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:07.230286 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:07.230298 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.231021 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.231026 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:07.231300 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.231958 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:35:07.231980 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:35:07.234383 (+ 2403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:35:07.237840 (+ 3457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:35:07.237848 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:35:07.237862 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:35:07.238514 (+ 652us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:35:07.238960 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:35:07.238963 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:35:07.238966 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:35:07.239239 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:35:07.239744 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:35:07.239750 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:35:07.240102 (+ 352us) client_negotiation.cc:769] Sending connection context
0808 08:35:07.240343 (+ 241us) client_negotiation.cc:240] Negotiation successful
0808 08:35:07.240776 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":363,"threads_started":1}
I20260808 08:35:07.243415 17546 heartbeater.cc:347] Connected to a master server at 127.5.164.254:39717
I20260808 08:35:07.243749 17546 heartbeater.cc:464] Registering TS with master...
I20260808 08:35:07.244505 17546 heartbeater.cc:511] Master 127.5.164.254:39717 requested a full tablet report, sending...
I20260808 08:35:07.246114 17058 ts_manager.cc:194] Registered new tserver with Master: 4d60c4dee51a40aeb5232a32bec7b781 (127.5.164.195:35609)
I20260808 08:35:07.246978 17058 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:50431
I20260808 08:35:07.251127 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:35:07.268692 17549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.256029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56676 (local address 127.5.164.254:39717)
0808 08:35:07.256296 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:07.256303 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:07.256542 (+ 239us) server_negotiation.cc:407] Connection header received
0808 08:35:07.256675 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:07.256678 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:07.256754 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:07.256839 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:07.258308 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.259040 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.260299 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.260717 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.260810 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.263101 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:07.263106 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:07.263109 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:35:07.263187 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:07.265856 (+ 2669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:07.266552 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:07.266556 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:07.266558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:07.266699 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:07.267118 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:07.267122 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:07.267124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:07.267523 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:07.267730 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:07.268160 (+ 430us) server_negotiation.cc:299] Negotiation successful
0808 08:35:07.268329 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 08:35:07.273126 17058 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56676:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:35:07.280220 17058 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:35:07.303828 17562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.292258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:35609 (local address 127.0.0.1:44178)
0808 08:35:07.294037 (+ 1779us) negotiation.cc:107] Waiting for socket to connect
0808 08:35:07.294100 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 08:35:07.294262 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:35:07.295705 (+ 1443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:35:07.295714 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:35:07.295761 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:35:07.296330 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:07.296345 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.298243 (+ 1898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.298249 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:07.300805 (+ 2556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:07.300818 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.302562 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.302569 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:07.302770 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.302912 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 08:35:07.303086 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 08:35:07.303325 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1555,"mutex_wait_us":58,"thread_start_us":3373,"threads_started":1}
I20260808 08:35:07.304692 17563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.292578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44178 (local address 127.5.164.195:35609)
0808 08:35:07.294973 (+ 2395us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:07.294982 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:07.295015 (+ 33us) server_negotiation.cc:407] Connection header received
0808 08:35:07.295121 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:07.295131 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:07.295420 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:07.296533 (+ 1113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:35:07.296782 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.298053 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.300969 (+ 2916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.302339 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.302479 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.302733 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:07.303124 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 08:35:07.304317 (+ 1193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2222,"thread_start_us":2026,"threads_started":1}
I20260808 08:35:07.304973 17561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.292430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:46665 (local address 127.0.0.1:46264)
0808 08:35:07.295948 (+ 3518us) negotiation.cc:107] Waiting for socket to connect
0808 08:35:07.295972 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:35:07.296189 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:35:07.297217 (+ 1028us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:35:07.297221 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:35:07.297245 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:35:07.297739 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:07.297752 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.299851 (+ 2099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.299856 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:07.301910 (+ 2054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:07.301927 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.304157 (+ 2230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.304165 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:07.304336 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.304367 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 08:35:07.304459 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 08:35:07.304599 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3355,"thread_start_us":1231,"threads_started":1}
I20260808 08:35:07.305059 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.293000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46264 (local address 127.5.164.194:46665)
0808 08:35:07.295437 (+ 2437us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:07.295449 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:07.296074 (+ 625us) server_negotiation.cc:407] Connection header received
0808 08:35:07.296400 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:07.296409 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:07.296667 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:07.296852 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:35:07.297979 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.299705 (+ 1726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.302089 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.303628 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.303764 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.303935 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:07.304531 (+ 596us) server_negotiation.cc:299] Negotiation successful
0808 08:35:07.304709 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2222,"thread_start_us":2330,"threads_started":1}
I20260808 08:35:07.307440 17566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.297280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37675 (local address 127.0.0.1:45948)
0808 08:35:07.297897 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0808 08:35:07.297913 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:35:07.298021 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:35:07.299913 (+ 1892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:35:07.299918 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:35:07.299941 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:35:07.300795 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:07.300811 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.302329 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.302334 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:07.304644 (+ 2310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:07.304658 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.306575 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.306581 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:07.306758 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.306799 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 08:35:07.306906 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 08:35:07.307034 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"mutex_wait_us":35,"thread_start_us":402,"threads_started":1}
I20260808 08:35:07.307507 17565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.296258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45948 (local address 127.5.164.193:37675)
0808 08:35:07.299335 (+ 3077us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:07.299342 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:07.299414 (+ 72us) server_negotiation.cc:407] Connection header received
0808 08:35:07.299509 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:07.299516 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:07.299692 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:07.300120 (+ 428us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:35:07.301021 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.302154 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.304830 (+ 2676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.306361 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.306513 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.306736 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:07.306957 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 08:35:07.307102 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2892,"thread_start_us":2706,"threads_started":1}
I20260808 08:35:07.308995 17476 tablet_service.cc:1467] Processing CreateTablet for tablet 27124e67e39e42daaa04ab7880d45f6e (DEFAULT_TABLE table=test-table [id=f47f663002894720a4da7300f1127db9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:35:07.309006 17332 tablet_service.cc:1467] Processing CreateTablet for tablet 27124e67e39e42daaa04ab7880d45f6e (DEFAULT_TABLE table=test-table [id=f47f663002894720a4da7300f1127db9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:35:07.310529 17476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27124e67e39e42daaa04ab7880d45f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:35:07.310524 17332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27124e67e39e42daaa04ab7880d45f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:35:07.312130 17191 tablet_service.cc:1467] Processing CreateTablet for tablet 27124e67e39e42daaa04ab7880d45f6e (DEFAULT_TABLE table=test-table [id=f47f663002894720a4da7300f1127db9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:35:07.313318 17191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 27124e67e39e42daaa04ab7880d45f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:35:07.325255 17567 tablet_bootstrap.cc:492] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323: Bootstrap starting.
I20260808 08:35:07.327355 17568 tablet_bootstrap.cc:492] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e: Bootstrap starting.
I20260808 08:35:07.328141 17569 tablet_bootstrap.cc:492] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781: Bootstrap starting.
I20260808 08:35:07.329229 17567 tablet_bootstrap.cc:654] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323: Neither blocks nor log segments found. Creating new log.
I20260808 08:35:07.330595 17567 log.cc:824] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323: Log is configured to *not* fsync() on all Append() calls
I20260808 08:35:07.331946 17569 tablet_bootstrap.cc:654] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781: Neither blocks nor log segments found. Creating new log.
I20260808 08:35:07.333434 17569 log.cc:824] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781: Log is configured to *not* fsync() on all Append() calls
I20260808 08:35:07.333645 17568 tablet_bootstrap.cc:654] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e: Neither blocks nor log segments found. Creating new log.
I20260808 08:35:07.334964 17568 log.cc:824] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:35:07.336557 17567 tablet_bootstrap.cc:492] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323: No bootstrap required, opened a new log
I20260808 08:35:07.336601 17569 tablet_bootstrap.cc:492] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781: No bootstrap required, opened a new log
I20260808 08:35:07.336841 17567 ts_tablet_manager.cc:1397] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.009s
I20260808 08:35:07.336860 17569 ts_tablet_manager.cc:1397] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 08:35:07.338069 17568 tablet_bootstrap.cc:492] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e: No bootstrap required, opened a new log
I20260808 08:35:07.338336 17568 ts_tablet_manager.cc:1397] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260808 08:35:07.344619 17567 raft_consensus.cc:348] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d60c4dee51a40aeb5232a32bec7b781" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35609 } } peers { permanent_uuid: "3a4a77b064a146a182e1cd4e0930793e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46665 } } peers { permanent_uuid: "ffc7dbf4db1a4f039722a46004e0c323" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37675 } }
I20260808 08:35:07.345002 17567 raft_consensus.cc:374] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:35:07.345132 17567 raft_consensus.cc:729] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc7dbf4db1a4f039722a46004e0c323, State: Initialized, Role: FOLLOWER
I20260808 08:35:07.345737 17567 consensus_queue.cc:260] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d60c4dee51a40aeb5232a32bec7b781" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35609 } } peers { permanent_uuid: "3a4a77b064a146a182e1cd4e0930793e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46665 } } peers { permanent_uuid: "ffc7dbf4db1a4f039722a46004e0c323" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37675 } }
I20260808 08:35:07.347632 17567 ts_tablet_manager.cc:1428] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260808 08:35:07.347844 17569 raft_consensus.cc:348] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d60c4dee51a40aeb5232a32bec7b781" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35609 } } peers { permanent_uuid: "3a4a77b064a146a182e1cd4e0930793e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46665 } } peers { permanent_uuid: "ffc7dbf4db1a4f039722a46004e0c323" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37675 } }
I20260808 08:35:07.348284 17569 raft_consensus.cc:374] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:35:07.348385 17569 raft_consensus.cc:729] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d60c4dee51a40aeb5232a32bec7b781, State: Initialized, Role: FOLLOWER
I20260808 08:35:07.348989 17569 consensus_queue.cc:260] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d60c4dee51a40aeb5232a32bec7b781" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35609 } } peers { permanent_uuid: "3a4a77b064a146a182e1cd4e0930793e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46665 } } peers { permanent_uuid: "ffc7dbf4db1a4f039722a46004e0c323" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37675 } }
I20260808 08:35:07.348989 17568 raft_consensus.cc:348] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d60c4dee51a40aeb5232a32bec7b781" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35609 } } peers { permanent_uuid: "3a4a77b064a146a182e1cd4e0930793e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46665 } } peers { permanent_uuid: "ffc7dbf4db1a4f039722a46004e0c323" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37675 } }
I20260808 08:35:07.349449 17568 raft_consensus.cc:374] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:35:07.349628 17568 raft_consensus.cc:729] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a4a77b064a146a182e1cd4e0930793e, State: Initialized, Role: FOLLOWER
I20260808 08:35:07.350234 17568 consensus_queue.cc:260] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d60c4dee51a40aeb5232a32bec7b781" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35609 } } peers { permanent_uuid: "3a4a77b064a146a182e1cd4e0930793e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46665 } } peers { permanent_uuid: "ffc7dbf4db1a4f039722a46004e0c323" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37675 } }
I20260808 08:35:07.350893 17569 ts_tablet_manager.cc:1428] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260808 08:35:07.350921 17546 heartbeater.cc:503] Master 127.5.164.254:39717 was elected leader, sending a full tablet report...
I20260808 08:35:07.351465 17401 heartbeater.cc:503] Master 127.5.164.254:39717 was elected leader, sending a full tablet report...
I20260808 08:35:07.352006 17568 ts_tablet_manager.cc:1428] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
W20260808 08:35:07.385061 17263 tablet.cc:2369] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:35:07.429308 17402 tablet.cc:2369] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:35:07.470794 17548 tablet.cc:2369] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:35:07.498883 17575 raft_consensus.cc:482] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:35:07.499373 17575 raft_consensus.cc:504] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d60c4dee51a40aeb5232a32bec7b781" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35609 } } peers { permanent_uuid: "3a4a77b064a146a182e1cd4e0930793e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46665 } } peers { permanent_uuid: "ffc7dbf4db1a4f039722a46004e0c323" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37675 } }
I20260808 08:35:07.501516 17575 leader_election.cc:288] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d60c4dee51a40aeb5232a32bec7b781 (127.5.164.195:35609), 3a4a77b064a146a182e1cd4e0930793e (127.5.164.194:46665)
I20260808 08:35:07.508541 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.502207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:58857 (local address 127.5.164.194:46665)
0808 08:35:07.502401 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:07.502408 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:07.502991 (+ 583us) server_negotiation.cc:407] Connection header received
0808 08:35:07.503285 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:07.503292 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:07.503388 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:07.503512 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:35:07.504084 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.504804 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.506581 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.507525 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.507702 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.507791 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:07.508116 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 08:35:07.508257 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 08:35:07.508701 17579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.501980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:46665 (local address 127.5.164.193:58857)
0808 08:35:07.502853 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0808 08:35:07.502880 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:35:07.503081 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:35:07.503554 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:35:07.503560 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:35:07.503593 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:35:07.503927 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:07.503936 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.504940 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.504947 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:07.506413 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:07.506429 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.507749 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.507756 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:07.507956 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.507980 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:35:07.508088 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 08:35:07.508221 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"mutex_wait_us":1,"thread_start_us":488,"threads_started":1}
I20260808 08:35:07.509179 17563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.502134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:52157 (local address 127.5.164.195:35609)
0808 08:35:07.502410 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:07.502418 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:07.503837 (+ 1419us) server_negotiation.cc:407] Connection header received
0808 08:35:07.504058 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:07.504062 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:07.504119 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:07.504221 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:35:07.504721 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.505444 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.507209 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.508075 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.508253 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.508336 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:07.508763 (+ 427us) server_negotiation.cc:299] Negotiation successful
0808 08:35:07.508900 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
I20260808 08:35:07.509788 17578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.502026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:35609 (local address 127.5.164.193:52157)
0808 08:35:07.503710 (+ 1684us) negotiation.cc:107] Waiting for socket to connect
0808 08:35:07.503741 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 08:35:07.503898 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:35:07.504231 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:35:07.504235 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:35:07.504258 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:35:07.504564 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:07.504572 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.505582 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.505589 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:07.507018 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:07.507030 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.508311 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.508318 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:07.508521 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.508562 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 08:35:07.509381 (+ 819us) client_negotiation.cc:240] Negotiation successful
0808 08:35:07.509509 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1538,"mutex_wait_us":41,"thread_start_us":1306,"threads_started":1}
I20260808 08:35:07.509774 17352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27124e67e39e42daaa04ab7880d45f6e" candidate_uuid: "ffc7dbf4db1a4f039722a46004e0c323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a4a77b064a146a182e1cd4e0930793e" is_pre_election: true
I20260808 08:35:07.510349 17352 raft_consensus.cc:2454] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc7dbf4db1a4f039722a46004e0c323 in term 0.
I20260808 08:35:07.511098 17498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27124e67e39e42daaa04ab7880d45f6e" candidate_uuid: "ffc7dbf4db1a4f039722a46004e0c323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d60c4dee51a40aeb5232a32bec7b781" is_pre_election: true
I20260808 08:35:07.511255 17142 leader_election.cc:302] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a4a77b064a146a182e1cd4e0930793e, ffc7dbf4db1a4f039722a46004e0c323; no voters:
I20260808 08:35:07.511713 17575 raft_consensus.cc:2781] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:35:07.511693 17498 raft_consensus.cc:2454] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc7dbf4db1a4f039722a46004e0c323 in term 0.
I20260808 08:35:07.511870 17575 raft_consensus.cc:482] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:35:07.512018 17575 raft_consensus.cc:3037] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:35:07.514465 17575 raft_consensus.cc:504] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d60c4dee51a40aeb5232a32bec7b781" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35609 } } peers { permanent_uuid: "3a4a77b064a146a182e1cd4e0930793e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46665 } } peers { permanent_uuid: "ffc7dbf4db1a4f039722a46004e0c323" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37675 } }
I20260808 08:35:07.515133 17575 leader_election.cc:288] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [CANDIDATE]: Term 1 election: Requested vote from peers 4d60c4dee51a40aeb5232a32bec7b781 (127.5.164.195:35609), 3a4a77b064a146a182e1cd4e0930793e (127.5.164.194:46665)
I20260808 08:35:07.515650 17498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27124e67e39e42daaa04ab7880d45f6e" candidate_uuid: "ffc7dbf4db1a4f039722a46004e0c323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d60c4dee51a40aeb5232a32bec7b781"
I20260808 08:35:07.515720 17352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "27124e67e39e42daaa04ab7880d45f6e" candidate_uuid: "ffc7dbf4db1a4f039722a46004e0c323" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a4a77b064a146a182e1cd4e0930793e"
I20260808 08:35:07.515890 17498 raft_consensus.cc:3037] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:35:07.515964 17352 raft_consensus.cc:3037] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:35:07.518181 17498 raft_consensus.cc:2454] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc7dbf4db1a4f039722a46004e0c323 in term 1.
I20260808 08:35:07.518206 17352 raft_consensus.cc:2454] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc7dbf4db1a4f039722a46004e0c323 in term 1.
I20260808 08:35:07.518630 17144 leader_election.cc:302] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d60c4dee51a40aeb5232a32bec7b781, ffc7dbf4db1a4f039722a46004e0c323; no voters:
I20260808 08:35:07.518986 17575 raft_consensus.cc:2781] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:35:07.519491 17575 raft_consensus.cc:686] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [term 1 LEADER]: Becoming Leader. State: Replica: ffc7dbf4db1a4f039722a46004e0c323, State: Running, Role: LEADER
I20260808 08:35:07.520020 17575 consensus_queue.cc:237] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d60c4dee51a40aeb5232a32bec7b781" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35609 } } peers { permanent_uuid: "3a4a77b064a146a182e1cd4e0930793e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46665 } } peers { permanent_uuid: "ffc7dbf4db1a4f039722a46004e0c323" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37675 } }
I20260808 08:35:07.524581 17056 catalog_manager.cc:5495] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 reported cstate change: term changed from 0 to 1, leader changed from <none> to ffc7dbf4db1a4f039722a46004e0c323 (127.5.164.193). New cstate: current_term: 1 leader_uuid: "ffc7dbf4db1a4f039722a46004e0c323" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d60c4dee51a40aeb5232a32bec7b781" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a4a77b064a146a182e1cd4e0930793e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc7dbf4db1a4f039722a46004e0c323" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37675 } health_report { overall_health: HEALTHY } } }
I20260808 08:35:07.541114 17565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.535675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51626 (local address 127.5.164.193:37675)
0808 08:35:07.535896 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:07.535904 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:07.535929 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:35:07.536215 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:07.536219 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:07.536297 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:07.536460 (+ 163us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:35:07.536839 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.537572 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.538890 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.539384 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.539553 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.540018 (+ 465us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:35:07.540497 (+ 479us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:35:07.540678 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:07.540736 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 08:35:07.540820 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 08:35:07.549405 17352 raft_consensus.cc:1261] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e [term 1 FOLLOWER]: Refusing update from remote peer ffc7dbf4db1a4f039722a46004e0c323: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:35:07.549413 17498 raft_consensus.cc:1261] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781 [term 1 FOLLOWER]: Refusing update from remote peer ffc7dbf4db1a4f039722a46004e0c323: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:35:07.550511 17580 consensus_queue.cc:1035] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d60c4dee51a40aeb5232a32bec7b781" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:35:07.550935 17575 consensus_queue.cc:1035] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a4a77b064a146a182e1cd4e0930793e" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 46665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:35:07.579625 17057 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56676:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:35:07.579936 17057 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56676:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:35:07.583940 17057 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fd64e8d77abc4d86a3a0a8beb251fefd: Sending DeleteTablet for 3 replicas of tablet 27124e67e39e42daaa04ab7880d45f6e
I20260808 08:35:07.585247 17332 tablet_service.cc:1514] Processing DeleteTablet for tablet 27124e67e39e42daaa04ab7880d45f6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:35:07 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:46264
I20260808 08:35:07.585268 17191 tablet_service.cc:1514] Processing DeleteTablet for tablet 27124e67e39e42daaa04ab7880d45f6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:35:07 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:45948
I20260808 08:35:07.585567 17476 tablet_service.cc:1514] Processing DeleteTablet for tablet 27124e67e39e42daaa04ab7880d45f6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:35:07 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:44178
I20260808 08:35:07.586364 17594 tablet_replica.cc:330] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e: stopping tablet replica
I20260808 08:35:07.587482 17594 raft_consensus.cc:2229] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:35:07.587909 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 17125
I20260808 08:35:07.588076 17594 raft_consensus.cc:2258] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:35:07.590801 17594 ts_tablet_manager.cc:1905] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:35:07.593545 17595 tablet_replica.cc:330] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323: stopping tablet replica
I20260808 08:35:07.593941 17595 raft_consensus.cc:2229] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:35:07.594610 17595 raft_consensus.cc:2258] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:35:07.596851 17595 ts_tablet_manager.cc:1905] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:35:07.600802 17594 ts_tablet_manager.cc:1918] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:35:07.600993 17594 log.cc:1196] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/27124e67e39e42daaa04ab7880d45f6e
I20260808 08:35:07.601594 17594 ts_tablet_manager.cc:1939] T 27124e67e39e42daaa04ab7880d45f6e P 3a4a77b064a146a182e1cd4e0930793e: Deleting consensus metadata
I20260808 08:35:07.603576 17041 catalog_manager.cc:4841] TS 3a4a77b064a146a182e1cd4e0930793e (127.5.164.194:46665): tablet 27124e67e39e42daaa04ab7880d45f6e (table test-table [id=f47f663002894720a4da7300f1127db9]) successfully deleted
I20260808 08:35:07.604590 17595 ts_tablet_manager.cc:1918] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:35:07.604863 17595 log.cc:1196] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/27124e67e39e42daaa04ab7880d45f6e
I20260808 08:35:07.605528 17595 ts_tablet_manager.cc:1939] T 27124e67e39e42daaa04ab7880d45f6e P ffc7dbf4db1a4f039722a46004e0c323: Deleting consensus metadata
I20260808 08:35:07.607383 17596 tablet_replica.cc:330] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781: stopping tablet replica
I20260808 08:35:07.607442 17043 catalog_manager.cc:4841] TS ffc7dbf4db1a4f039722a46004e0c323 (127.5.164.193:37675): tablet 27124e67e39e42daaa04ab7880d45f6e (table test-table [id=f47f663002894720a4da7300f1127db9]) successfully deleted
I20260808 08:35:07.607867 17596 raft_consensus.cc:2229] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:35:07.608417 17596 raft_consensus.cc:2258] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:35:07.610855 17596 ts_tablet_manager.cc:1905] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 08:35:07 dist-test-slave-chsk krb5kdc[17010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:35:07.617441 17596 ts_tablet_manager.cc:1918] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:35:07.617622 17596 log.cc:1196] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/27124e67e39e42daaa04ab7880d45f6e
I20260808 08:35:07.618196 17596 ts_tablet_manager.cc:1939] T 27124e67e39e42daaa04ab7880d45f6e P 4d60c4dee51a40aeb5232a32bec7b781: Deleting consensus metadata
I20260808 08:35:07.620069 17043 catalog_manager.cc:4841] TS 4d60c4dee51a40aeb5232a32bec7b781 (127.5.164.195:35609): tablet 27124e67e39e42daaa04ab7880d45f6e (table test-table [id=f47f663002894720a4da7300f1127db9]) successfully deleted
I20260808 08:35:07.622157 17565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.590625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51640 (local address 127.5.164.193:37675)
0808 08:35:07.590833 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:07.590839 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:07.599604 (+ 8765us) server_negotiation.cc:407] Connection header received
0808 08:35:07.599950 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:07.599959 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:07.600103 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:07.600184 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:07.602613 (+ 2429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.604253 (+ 1640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.607436 (+ 3183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.608205 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.608311 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.614094 (+ 5783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:07.614111 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:07.614129 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:35:07.614190 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:07.618764 (+ 4574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:07.619764 (+ 1000us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:07.619773 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:07.619776 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:07.619980 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:07.620436 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:07.620441 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:07.620445 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:07.620872 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:07.621219 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:07.621514 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 08:35:07.621769 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:35:07.622907 17256 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:35:07.724411 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 17125
I20260808 08:35:07.750558 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 17268
Aug 08 08:35:07 dist-test-slave-chsk krb5kdc[17010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:35:07.765908 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.751377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36942 (local address 127.5.164.194:46665)
0808 08:35:07.751579 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:07.751588 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:07.751613 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:35:07.751840 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:07.751845 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:07.751910 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:07.752021 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:07.753305 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.754041 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.755559 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.755950 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.756117 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.760638 (+ 4521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:07.760658 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:07.760678 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:35:07.760726 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:07.763507 (+ 2781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:07.764177 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:07.764184 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:07.764186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:07.764306 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:07.764628 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:07.764631 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:07.764633 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:07.765029 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:07.765240 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:07.765470 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 08:35:07.765641 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:35:07.766606 17396 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:35:07.859162 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 17268
I20260808 08:35:07.878554 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 17409
Aug 08 08:35:07 dist-test-slave-chsk krb5kdc[17010](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:35:07.893386 17563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:07.879401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52060 (local address 127.5.164.195:35609)
0808 08:35:07.879588 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:07.879593 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:07.879611 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:35:07.879758 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:07.879762 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:07.879823 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:07.879904 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:07.881196 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.881892 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.883099 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:07.883647 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:07.883743 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:07.888173 (+ 4430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:07.888188 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:07.888213 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:35:07.888246 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:07.890759 (+ 2513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:07.891547 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:07.891554 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:07.891556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:07.891699 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:07.892027 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:07.892030 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:07.892032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:07.892387 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:07.892611 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:07.892857 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 08:35:07.893019 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:35:07.894086 17541 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:35:07.983734 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 17409
I20260808 08:35:08.002844 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 17024
I20260808 08:35:08.004138 17089 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:35:08.116997 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 17024
2026-08-08T08:35:08Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4563 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:35:08 dist-test-slave-chsk krb5kdc[17605](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:35:08 dist-test-slave-chsk krb5kdc[17605](info): set up 2 sockets
Aug 08 08:35:08 dist-test-slave-chsk krb5kdc[17605](info): commencing operation
krb5kdc: starting...
W20260808 08:35:09.279668 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:35:09 dist-test-slave-chsk krb5kdc[17605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:35:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:35:09Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.5.164.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.5.164.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.5.164.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/rangeradmin_127.5.164.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.5.164.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/rangeradmin_127.5.164.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.5.164.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.5.164.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.5.164.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/rangerlookup_127.5.164.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.5.164.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/rangerlookup_127.5.164.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.5.164.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.164.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.164.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/HTTP_127.5.164.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.5.164.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/HTTP_127.5.164.212@KRBTEST.COM.keytab.
I20260808 08:35:09.710035 5779 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskp0Id9M/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/postgres -l logfile start
2026-08-08 08:35:12.334 UTC [17637] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 08:35:12.334 UTC [17637] LOG: listening on IPv4 address "127.5.164.212", port 42217
2026-08-08 08:35:12.338 UTC [17637] LOG: listening on Unix socket "/tmp/.s.PGSQL.42217"
2026-08-08 08:35:12.362 UTC [17640] LOG: database system was shut down at 2026-08-08 08:35:10 UTC
2026-08-08 08:35:12.366 UTC [17637] LOG: database system is ready to accept connections
I20260808 08:35:13.387082 5779 mini_postgres.cc:96] Postgres bound to 42217
2026-08-08 08:35:13.413 UTC [17650] FATAL: database "slave" does not exist
127.5.164.212:42217 - accepting connections
I20260808 08:35:13.414170 5779 mini_ranger.cc:161] Starting Ranger...
I20260808 08:35:13.447728 5779 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 08:35:13.966982 5779 mini_ranger.cc:87] Created ranger Postgres database
I20260808 08:35:13.967162 5779 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-admin
2026-08-08 08:35:14,301 [I] DB FLAVOR :POSTGRES
2026-08-08 08:35:14,302 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 08:35:14,302 [I] Checking connection..
2026-08-08 08:35:14,302 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 08:35:14,551 [I] Checking connection passed.
2026-08-08 08:35:14,551 [I] --------- Verifying version history table ---------
2026-08-08 08:35:14,551 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:35:14,816 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 08:35:14,816 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:35:15,082 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 08:35:15,082 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 08:35:15,082 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 08:35:15.321 UTC [17719] WARNING: there is no transaction in progress
2026-08-08 08:35:15,329 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 08:35:15,329 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:35:15,602 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 08:35:15,603 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 08:35:15,603 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 08:35:15,880 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 08:35:16,152 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-chsk.c.gcp-upstream.internal','N') ;"
2026-08-08 08:35:16,414 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 08:35:16,680 [I] Table x_portal_user does not exist in database ranger
2026-08-08 08:35:16,681 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 08:35:16,971 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 08:35:16,971 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 08:35:17,236 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 08:35:17,506 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 08:35:17,506 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 08:35:18.526 UTC [17835] WARNING: there is no transaction in progress
2026-08-08 08:35:18.542 UTC [17835] WARNING: there is no transaction in progress
2026-08-08 08:35:18.559 UTC [17835] WARNING: there is no transaction in progress
2026-08-08 08:35:18.576 UTC [17835] WARNING: there is no transaction in progress
2026-08-08 08:35:18.593 UTC [17835] WARNING: there is no transaction in progress
2026-08-08 08:35:18.613 UTC [17835] WARNING: there is no transaction in progress
2026-08-08 08:35:18.678 UTC [17835] WARNING: there is no transaction in progress
2026-08-08 08:35:18.685 UTC [17835] WARNING: there is no transaction in progress
2026-08-08 08:35:18.699 UTC [17835] WARNING: there is no transaction in progress
2026-08-08 08:35:18.708 UTC [17835] WARNING: there is no transaction in progress
2026-08-08 08:35:18.718 UTC [17835] WARNING: there is no transaction in progress
2026-08-08 08:35:18.731 UTC [17835] WARNING: there is no transaction in progress
2026-08-08 08:35:18.742 UTC [17835] WARNING: there is no transaction in progress
2026-08-08 08:35:18.749 UTC [17835] WARNING: there is no transaction in progress
2026-08-08 08:35:18.757 UTC [17835] WARNING: there is no transaction in progress
2026-08-08 08:35:18.764 UTC [17835] WARNING: there is no transaction in progress
2026-08-08 08:35:19,433 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 08:35:19,433 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 08:35:19,669 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 08:35:19,669 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 08:35:19,929 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 08:35:19,929 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 08:35:20,194 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 08:35:20,194 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 08:35:20,441 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 08:35:20,677 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-chsk.c.gcp-upstream.internal';"
2026-08-08 08:35:20,928 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 08:35:20,928 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 08:35:21,195 [I] DB_PATCHES have already been applied
I20260808 08:35:21.201278 5779 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-admin:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskp0Id9M/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 08:35:21.201368 5779 mini_ranger.cc:193] Using host: 127.5.164.212
I20260808 08:35:21.224711 5779 mini_ranger.cc:227] Ranger admin URL: http://127.5.164.212:55645
Aug 08, 2026 8:35:21 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 8:35:21 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 8:35:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 8:35:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 8:35:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 8:35:22 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 8:35:22 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 08:35:22.432426 5779 mini_ranger.cc:160] Time spent starting Ranger: real 9.018s user 0.003s sys 0.068s
Aug 08, 2026 8:35:43 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 8:35:43 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 8:35:43 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 8:35:43 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 8:35:43 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 8:35:43 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 8:35:43 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 8:35:43 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 8:35:43 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 8:35:43 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 8:35:43 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 8:35:43 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 8:35:43 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 8:35:43 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 8:35:43 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 8:35:43 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 8:35:43 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 8:35:44 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 08:35:45.445493 5779 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.5.164.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.5.164.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.5.164.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/rangerkms_127.5.164.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.5.164.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/rangerkms_127.5.164.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.5.164.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.5.164.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.164.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/HTTP_127.5.164.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.5.164.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/HTTP_127.5.164.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 08:35:45 dist-test-slave-chsk krb5kdc[17605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178145, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 08:35:45.659590 5779 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 08:35:45.690282 5779 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 08:35:46.627159 5779 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 08:35:46.627344 5779 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-kms
I20260808 08:35:46.627485 5779 mini_ranger_kms.cc:227] Using postgres at 127.5.164.212:42217
2026-08-08 08:35:47,139 [I] DB FLAVOR :POSTGRES
2026-08-08 08:35:47,139 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 08:35:47,139 [I] Checking connection
2026-08-08 08:35:47,139 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 08:35:47,381 [I] connection success
2026-08-08 08:35:47,381 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 08:35:47,381 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 08:35:47,382 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 08:35:47,652 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 08:35:47,652 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 08:35:47,652 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 08:35:47,653 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:42217/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 08:35:47,924 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 08:35:48.474956 5779 mini_ranger_kms.cc:310] Created kms service
I20260808 08:35:48.649775 5779 mini_ranger_kms.cc:326] Created kudu user
I20260808 08:35:48.695387 5779 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 08:35:48 dist-test-slave-chsk krb5kdc[17605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178145, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
I20260808 08:35:49.113823 5779 mini_ranger_kms.cc:384] Added ranger policy
I20260808 08:35:49.115556 5779 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-kms:/tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 08:35:49.115650 5779 mini_ranger_kms.cc:240] Using host: 127.5.164.212
I20260808 08:35:49.150566 5779 mini_ranger_kms.cc:276] Ranger KMS PID: 18027
I20260808 08:35:49.150796 5779 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.5.164.212:42965
Aug 08, 2026 8:35:50 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 8:35:50 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 8:35:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 8:35:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 8:35:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 8:35:50 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 08:35:51 dist-test-slave-chsk krb5kdc[17605](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786178151, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.164.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:35:51.578104 5779 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.919s user 0.119s sys 0.444s
I20260808 08:35:51.578562 5779 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 08:35:51.578806 5779 mini_ranger_kms.cc:401] 127.5.164.212:42965/kms/v1/keys
Aug 08 08:35:51 dist-test-slave-chsk krb5kdc[17605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178151, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.164.212@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
Aug 08 08:35:52 dist-test-slave-chsk krb5kdc[17605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178151, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.164.212@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
Aug 08 08:35:54 dist-test-slave-chsk krb5kdc[17605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178154, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:35:54.855779 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:35553
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:35553
--ranger_config_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.164.212:42965/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:35:55.483639 18079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:35:55.483952 18079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:35:55.484081 18079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:35:55.493888 18079 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:35:55.494094 18079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:35:55.494190 18079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:35:55.494303 18079 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:35:55.494391 18079 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:35:55.507131 18079 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/wal
--ranger_kms_url=127.5.164.212:42965/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:35553
--ranger_config_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:35553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:35:55.508431 18079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:35:55.509951 18079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:35:55.526753 18085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:55.527007 18087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:55.527243 18084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:35:55.528597 18079 server_base.cc:1034] running on GCE node
I20260808 08:35:55.529521 18079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:35:55.531203 18079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:35:55.532490 18079 hybrid_clock.cc:648] HybridClock initialized: now 1786178155532370 us; error 79 us; skew 500 ppm
I20260808 08:35:55.533061 18079 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:35:55 dist-test-slave-chsk krb5kdc[17605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178155, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:35:55.537740 18079 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:35:55.540119 18079 webserver.cc:460] Webserver started at http://127.5.164.254:43969/ using document root <none> and password file <none>
I20260808 08:35:55.540985 18079 fs_manager.cc:359] Metadata directory not provided
I20260808 08:35:55.541157 18079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:35:55.541543 18079 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:35:55 dist-test-slave-chsk krb5kdc[17605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178155, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
I20260808 08:35:55.617275 18079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "5b23c78607954ef9be144cadb6aa7d64"
format_stamp: "Formatted at 2026-08-08 08:35:55 on dist-test-slave-chsk"
server_key: "99da91096495843c2fee5d23ae112e4c"
server_key_iv: "111cd262ea445de47cd9218abe1c904b"
server_key_version: "kuduclusterkey@0"
I20260808 08:35:55.618464 18079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "5b23c78607954ef9be144cadb6aa7d64"
format_stamp: "Formatted at 2026-08-08 08:35:55 on dist-test-slave-chsk"
server_key: "99da91096495843c2fee5d23ae112e4c"
server_key_iv: "111cd262ea445de47cd9218abe1c904b"
server_key_version: "kuduclusterkey@0"
I20260808 08:35:55.625788 18079 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.005s
I20260808 08:35:55.648211 18094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:55.649879 18079 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260808 08:35:55.650183 18079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "5b23c78607954ef9be144cadb6aa7d64"
format_stamp: "Formatted at 2026-08-08 08:35:55 on dist-test-slave-chsk"
server_key: "99da91096495843c2fee5d23ae112e4c"
server_key_iv: "111cd262ea445de47cd9218abe1c904b"
server_key_version: "kuduclusterkey@0"
I20260808 08:35:55.650571 18079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:35:55.686902 18079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:35:55.691772 18079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:35:55.692209 18079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:35:55.746343 18079 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:35553
I20260808 08:35:55.746503 18149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:35553 every 8 connection(s)
I20260808 08:35:55.748232 18079 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:35:55.753638 18150 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:35:55.757874 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 18079
I20260808 08:35:55.758165 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:35:55.759248 5779 external_mini_cluster.cc:1428] Setting key b3f0bb234ebfae1605c47709843b0466
I20260808 08:35:55.771438 18150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64: Bootstrap starting.
I20260808 08:35:55.775820 18150 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64: Neither blocks nor log segments found. Creating new log.
Aug 08 08:35:55 dist-test-slave-chsk krb5kdc[17605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178154, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:35:55.777837 18150 log.cc:824] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64: Log is configured to *not* fsync() on all Append() calls
I20260808 08:35:55.782354 18150 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64: No bootstrap required, opened a new log
I20260808 08:35:55.788267 18153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:55.762198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55112 (local address 127.5.164.254:35553)
0808 08:35:55.763971 (+ 1773us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:55.763993 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:55.764037 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:35:55.766683 (+ 2646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:55.766706 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:55.767133 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:55.767606 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:55.769155 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:55.771092 (+ 1937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:55.772553 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:55.773438 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:55.773660 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:55.778361 (+ 4701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:55.778370 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:55.778384 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:35:55.778473 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:55.783419 (+ 4946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:55.784208 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:55.784215 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:55.784221 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:55.784426 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:55.784877 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:55.784883 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:55.784886 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:55.785474 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:55.785840 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:55.786333 (+ 493us) server_negotiation.cc:299] Negotiation successful
0808 08:35:55.786849 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1514,"thread_start_us":1107,"threads_started":1}
I20260808 08:35:55.795318 18150 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b23c78607954ef9be144cadb6aa7d64" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35553 } }
I20260808 08:35:55.795954 18150 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:35:55.796149 18150 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b23c78607954ef9be144cadb6aa7d64, State: Initialized, Role: FOLLOWER
I20260808 08:35:55.796887 18150 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b23c78607954ef9be144cadb6aa7d64" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35553 } }
I20260808 08:35:55.797272 18150 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:35:55.797441 18150 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:35:55.797677 18150 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:35:55.801213 18150 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b23c78607954ef9be144cadb6aa7d64" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35553 } }
I20260808 08:35:55.801824 18150 leader_election.cc:302] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b23c78607954ef9be144cadb6aa7d64; no voters:
I20260808 08:35:55.802942 18150 leader_election.cc:288] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:35:55.803174 18155 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:35:55.806279 18150 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:35:55.807309 18155 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [term 1 LEADER]: Becoming Leader. State: Replica: 5b23c78607954ef9be144cadb6aa7d64, State: Running, Role: LEADER
I20260808 08:35:55.808406 18155 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b23c78607954ef9be144cadb6aa7d64" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35553 } }
I20260808 08:35:55.813846 18156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b23c78607954ef9be144cadb6aa7d64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b23c78607954ef9be144cadb6aa7d64" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35553 } } }
I20260808 08:35:55.814476 18156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [sys.catalog]: This master's current role is: LEADER
I20260808 08:35:55.814054 18157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b23c78607954ef9be144cadb6aa7d64. Latest consensus state: current_term: 1 leader_uuid: "5b23c78607954ef9be144cadb6aa7d64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b23c78607954ef9be144cadb6aa7d64" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35553 } } }
I20260808 08:35:55.816088 18157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64 [sys.catalog]: This master's current role is: LEADER
I20260808 08:35:55.819784 18165 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:35:55.838603 18165 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:35:55.840251 18150 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 08:35:55.870388 18165 catalog_manager.cc:1347] Generated new cluster ID: 4d8b6eb292ca46219cae08b17f2b322d
I20260808 08:35:55.870656 18165 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:35:55.886821 18165 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:35:55.889456 18165 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:35:55.902246 18165 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64: Generated new TSK 0
I20260808 08:35:55.903659 18165 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:35:56.787442 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.164.212:42965/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:35553
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:35:57 dist-test-slave-chsk krb5kdc[17605](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786178157, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 08:35:57.407361 18199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:35:57.407967 18199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:35:57.408272 18199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:35:57.422158 18199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:35:57.422458 18199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:35:57.422770 18199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:35:57.440476 18199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.5.164.212:42965/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:35553
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:35:57.442142 18199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:35:57.443665 18199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:35:57.465195 18210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:57.465504 18213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:57.465194 18211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:35:57.474431 18199 server_base.cc:1034] running on GCE node
I20260808 08:35:57.475746 18199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:35:57.477639 18199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:35:57.479031 18199 hybrid_clock.cc:648] HybridClock initialized: now 1786178157478875 us; error 81 us; skew 500 ppm
I20260808 08:35:57.479777 18199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:35:57 dist-test-slave-chsk krb5kdc[17605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178157, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:35:57.486526 18199 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:35:57.489795 18199 webserver.cc:460] Webserver started at http://127.5.164.193:44093/ using document root <none> and password file <none>
I20260808 08:35:57.491262 18199 fs_manager.cc:359] Metadata directory not provided
I20260808 08:35:57.491485 18199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:35:57.492086 18199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:35:57 dist-test-slave-chsk krb5kdc[17605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178157, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
I20260808 08:35:57.523180 18199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "bd75a56311654f90bf66a1d97c817d38"
format_stamp: "Formatted at 2026-08-08 08:35:57 on dist-test-slave-chsk"
server_key: "3403225fde20f95d827217459d412f03"
server_key_iv: "39f39ee1ba0c142295116bff1d71d3b5"
server_key_version: "kuduclusterkey@0"
I20260808 08:35:57.524827 18199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "bd75a56311654f90bf66a1d97c817d38"
format_stamp: "Formatted at 2026-08-08 08:35:57 on dist-test-slave-chsk"
server_key: "3403225fde20f95d827217459d412f03"
server_key_iv: "39f39ee1ba0c142295116bff1d71d3b5"
server_key_version: "kuduclusterkey@0"
I20260808 08:35:57.541894 18199 fs_manager.cc:691] Time spent creating directory manager: real 0.016s user 0.015s sys 0.000s
I20260808 08:35:57.570669 18220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:57.573050 18199 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.001s sys 0.009s
I20260808 08:35:57.573418 18199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "bd75a56311654f90bf66a1d97c817d38"
format_stamp: "Formatted at 2026-08-08 08:35:57 on dist-test-slave-chsk"
server_key: "3403225fde20f95d827217459d412f03"
server_key_iv: "39f39ee1ba0c142295116bff1d71d3b5"
server_key_version: "kuduclusterkey@0"
I20260808 08:35:57.573861 18199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:35:57.640856 18199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:35:57.648057 18199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:35:57.648864 18199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:35:57.655561 18199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:35:57.658692 18199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:35:57.658833 18199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:57.659204 18199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:35:57.659572 18199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 08:35:57 dist-test-slave-chsk krb5kdc[17605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178157, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
I20260808 08:35:57.907850 18199 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:40919
I20260808 08:35:57.907873 18343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:40919 every 8 connection(s)
I20260808 08:35:57.911048 18199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:35:57.915720 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 18199
I20260808 08:35:57.915995 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:35:57.917462 5779 external_mini_cluster.cc:1428] Setting key 1e290875f40ad377a8583d6fb76b0529
Aug 08 08:35:57 dist-test-slave-chsk krb5kdc[17605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178157, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:35:57.963892 18347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:57.916253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:35553 (local address 127.5.164.193:51895)
0808 08:35:57.923506 (+ 7253us) negotiation.cc:107] Waiting for socket to connect
0808 08:35:57.923583 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0808 08:35:57.927815 (+ 4232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:35:57.929091 (+ 1276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:35:57.929106 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:35:57.930121 (+ 1015us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:35:57.931385 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:57.931423 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:57.933438 (+ 2015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:57.933446 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:57.936627 (+ 3181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:57.936645 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:57.938779 (+ 2134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:57.938790 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:57.939363 (+ 573us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:57.940710 (+ 1347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:35:57.940765 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:35:57.945629 (+ 4864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:35:57.957218 (+ 11589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:35:57.957230 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:35:57.957251 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:35:57.958138 (+ 887us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:35:57.958826 (+ 688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:35:57.958832 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:35:57.958835 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:35:57.959221 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:35:57.960094 (+ 873us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:35:57.960103 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:35:57.960663 (+ 560us) client_negotiation.cc:769] Sending connection context
0808 08:35:57.961088 (+ 425us) client_negotiation.cc:240] Negotiation successful
0808 08:35:57.961766 (+ 678us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6800,"thread_start_us":8560,"threads_started":1}
I20260808 08:35:57.965535 18346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:57.915270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:51895 (local address 127.5.164.254:35553)
0808 08:35:57.922592 (+ 7322us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:57.922600 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:57.925762 (+ 3162us) server_negotiation.cc:407] Connection header received
0808 08:35:57.928253 (+ 2491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:57.928261 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:57.928364 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:57.928587 (+ 223us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:57.931662 (+ 3075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:57.933211 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:57.936868 (+ 3657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:57.938033 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:57.938200 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:57.946027 (+ 7827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:57.946035 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:57.946042 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:35:57.946086 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:57.956940 (+ 10854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:57.958401 (+ 1461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:57.958407 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:57.958410 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:57.958673 (+ 263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:57.959391 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:57.959396 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:57.959399 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:57.959912 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:57.964434 (+ 4522us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:57.964594 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 08:35:57.964933 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7123,"thread_start_us":10319,"threads_started":1}
I20260808 08:35:57.968676 18344 heartbeater.cc:347] Connected to a master server at 127.5.164.254:35553
I20260808 08:35:57.969122 18344 heartbeater.cc:464] Registering TS with master...
I20260808 08:35:57.970352 18344 heartbeater.cc:511] Master 127.5.164.254:35553 requested a full tablet report, sending...
I20260808 08:35:57.974107 18112 ts_manager.cc:194] Registered new tserver with Master: bd75a56311654f90bf66a1d97c817d38 (127.5.164.193:40919)
I20260808 08:35:57.976768 18112 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:51895
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
W20260808 08:35:58.024279 5779 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.5.164.194: real 0.103s user 0.000s sys 0.042s
I20260808 08:35:58.025117 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.164.212:42965/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:35553
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:35:58 dist-test-slave-chsk krb5kdc[17605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178157, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
W20260808 08:35:58.704978 18351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:35:58.705325 18351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:35:58.705569 18351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:35:58.715458 18351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:35:58.715734 18351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:35:58.715997 18351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:35:58.733628 18351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.5.164.212:42965/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:35553
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:35:58.735229 18351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:35:58.736856 18351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:35:58.760914 18369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:58.760950 18368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:58.763424 18371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:35:58.769200 18351 server_base.cc:1034] running on GCE node
I20260808 08:35:58.770093 18351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:35:58.771251 18351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:35:58.772485 18351 hybrid_clock.cc:648] HybridClock initialized: now 1786178158772418 us; error 49 us; skew 500 ppm
I20260808 08:35:58.772863 18351 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:35:58 dist-test-slave-chsk krb5kdc[17605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178158, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:35:58.777504 18351 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:35:58.779824 18351 webserver.cc:460] Webserver started at http://127.5.164.194:46563/ using document root <none> and password file <none>
I20260808 08:35:58.780642 18351 fs_manager.cc:359] Metadata directory not provided
I20260808 08:35:58.780815 18351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:35:58.781248 18351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:35:58 dist-test-slave-chsk krb5kdc[17605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178158, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
I20260808 08:35:58.798836 18351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "4481c053f190452cae92a41f8041f06c"
format_stamp: "Formatted at 2026-08-08 08:35:58 on dist-test-slave-chsk"
server_key: "3ad9a1137a2c345413484591de95016c"
server_key_iv: "ad170ed2ebcd5c743db28e5d3a1aa16b"
server_key_version: "kuduclusterkey@0"
I20260808 08:35:58.800179 18351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "4481c053f190452cae92a41f8041f06c"
format_stamp: "Formatted at 2026-08-08 08:35:58 on dist-test-slave-chsk"
server_key: "3ad9a1137a2c345413484591de95016c"
server_key_iv: "ad170ed2ebcd5c743db28e5d3a1aa16b"
server_key_version: "kuduclusterkey@0"
I20260808 08:35:58.807601 18351 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260808 08:35:58.827663 18379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:58.829813 18351 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:35:58.830063 18351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "4481c053f190452cae92a41f8041f06c"
format_stamp: "Formatted at 2026-08-08 08:35:58 on dist-test-slave-chsk"
server_key: "3ad9a1137a2c345413484591de95016c"
server_key_iv: "ad170ed2ebcd5c743db28e5d3a1aa16b"
server_key_version: "kuduclusterkey@0"
I20260808 08:35:58.830420 18351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:35:58.866227 18351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:35:58.872560 18351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:35:58.873205 18351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:35:58.874802 18351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:35:58.877156 18351 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:35:58.877291 18351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:58.877504 18351 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:35:58.877645 18351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:58.981353 18344 heartbeater.cc:503] Master 127.5.164.254:35553 was elected leader, sending a full tablet report...
I20260808 08:35:59.006048 18351 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:41267
I20260808 08:35:59.006081 18497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:41267 every 8 connection(s)
I20260808 08:35:59.008111 18351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:35:59.017205 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 18351
I20260808 08:35:59.017405 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:35:59.018026 5779 external_mini_cluster.cc:1428] Setting key 10f38b3950061e7e39626fbbf4bf2b46
Aug 08 08:35:59 dist-test-slave-chsk krb5kdc[17605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178158, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:35:59.046316 18502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:59.014720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:34479 (local address 127.5.164.254:35553)
0808 08:35:59.028119 (+ 13399us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:59.028129 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:59.028153 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:35:59.028247 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:59.028252 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:59.028401 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:59.028796 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:59.030732 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:59.031833 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:59.033787 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:59.034274 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:59.034421 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:59.038709 (+ 4288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:59.038714 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:59.038718 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:35:59.038783 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:59.042490 (+ 3707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:59.043417 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:59.043424 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:59.043429 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:59.043588 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:59.044168 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:59.044171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:59.044174 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:59.044536 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:59.044733 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:59.045569 (+ 836us) server_negotiation.cc:299] Negotiation successful
0808 08:35:59.045806 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13183,"thread_start_us":12927,"threads_started":1}
I20260808 08:35:59.047739 18500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:59.013644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:35553 (local address 127.5.164.194:34479)
0808 08:35:59.024394 (+ 10750us) negotiation.cc:107] Waiting for socket to connect
0808 08:35:59.024457 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 08:35:59.026776 (+ 2319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:35:59.029081 (+ 2305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:35:59.029090 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:35:59.029703 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:35:59.030534 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:59.030556 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:59.032024 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:59.032028 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:59.033637 (+ 1609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:59.033650 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:59.034609 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:59.034618 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:59.034838 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:59.035635 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:35:59.035660 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:35:59.038393 (+ 2733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:35:59.042661 (+ 4268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:35:59.042671 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:35:59.042690 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:35:59.043292 (+ 602us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:35:59.043718 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:35:59.043723 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:35:59.043726 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:35:59.044020 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:35:59.044691 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:35:59.044700 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:35:59.045103 (+ 403us) client_negotiation.cc:769] Sending connection context
0808 08:35:59.045448 (+ 345us) client_negotiation.cc:240] Negotiation successful
0808 08:35:59.046044 (+ 596us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10338,"thread_start_us":10077,"threads_started":1}
I20260808 08:35:59.049793 18498 heartbeater.cc:347] Connected to a master server at 127.5.164.254:35553
I20260808 08:35:59.050264 18498 heartbeater.cc:464] Registering TS with master...
I20260808 08:35:59.051192 18498 heartbeater.cc:511] Master 127.5.164.254:35553 requested a full tablet report, sending...
I20260808 08:35:59.053078 18112 ts_manager.cc:194] Registered new tserver with Master: 4481c053f190452cae92a41f8041f06c (127.5.164.194:41267)
I20260808 08:35:59.054558 18112 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:34479
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:35:59.118697 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.164.212:42965/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:35553
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42847
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:35:59.685737 18505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:35:59.686198 18505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:35:59.686396 18505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:35:59.695875 18505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:35:59.696036 18505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:35:59.696285 18505 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:35:59.711457 18505 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42847
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.5.164.212:42965/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:35553
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:35:59.713879 18505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:35:59.716244 18505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:35:59.738535 18511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:59.739554 18514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:35:59.740974 18512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:35:59.742425 18505 server_base.cc:1034] running on GCE node
I20260808 08:35:59.743399 18505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:35:59.744656 18505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:35:59.745940 18505 hybrid_clock.cc:648] HybridClock initialized: now 1786178159745839 us; error 50 us; skew 500 ppm
I20260808 08:35:59.746409 18505 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:35:59 dist-test-slave-chsk krb5kdc[17605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178159, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:35:59.751391 18505 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:35:59.754812 18505 webserver.cc:460] Webserver started at http://127.5.164.195:42681/ using document root <none> and password file <none>
I20260808 08:35:59.755860 18505 fs_manager.cc:359] Metadata directory not provided
I20260808 08:35:59.756031 18505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:35:59.756501 18505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:35:59 dist-test-slave-chsk krb5kdc[17605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178159, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
I20260808 08:35:59.773530 18505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "9c004b1dd0bb479aa19d6362f35a5744"
format_stamp: "Formatted at 2026-08-08 08:35:59 on dist-test-slave-chsk"
server_key: "3e1333de5bff748e05cb9350467c5ad0"
server_key_iv: "131d6e3bc00574917767c826cac933ca"
server_key_version: "kuduclusterkey@0"
I20260808 08:35:59.774538 18505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "9c004b1dd0bb479aa19d6362f35a5744"
format_stamp: "Formatted at 2026-08-08 08:35:59 on dist-test-slave-chsk"
server_key: "3e1333de5bff748e05cb9350467c5ad0"
server_key_iv: "131d6e3bc00574917767c826cac933ca"
server_key_version: "kuduclusterkey@0"
I20260808 08:35:59.781476 18505 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260808 08:35:59.801096 18521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:59.802899 18505 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.003s
I20260808 08:35:59.803237 18505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "9c004b1dd0bb479aa19d6362f35a5744"
format_stamp: "Formatted at 2026-08-08 08:35:59 on dist-test-slave-chsk"
server_key: "3e1333de5bff748e05cb9350467c5ad0"
server_key_iv: "131d6e3bc00574917767c826cac933ca"
server_key_version: "kuduclusterkey@0"
I20260808 08:35:59.803596 18505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:35:59.847302 18505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:35:59.853075 18505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:35:59.853698 18505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:35:59.855463 18505 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:35:59.858062 18505 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:35:59.858173 18505 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:59.858376 18505 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:35:59.858533 18505 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:35:59.948176 18505 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:36681
I20260808 08:35:59.948284 18641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:36681 every 8 connection(s)
I20260808 08:35:59.949798 18505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:35:59.952878 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 18505
I20260808 08:35:59.953125 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:35:59.953815 5779 external_mini_cluster.cc:1428] Setting key 143919f471d55ea42fe1b97a6c5670fa
Aug 08 08:35:59 dist-test-slave-chsk krb5kdc[17605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178159, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:35:59.979684 18644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:59.953740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:36239 (local address 127.5.164.254:35553)
0808 08:35:59.954820 (+ 1080us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:59.954827 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:59.956478 (+ 1651us) server_negotiation.cc:407] Connection header received
0808 08:35:59.959329 (+ 2851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:59.959334 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:59.959477 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:59.959742 (+ 265us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:59.962289 (+ 2547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:59.963296 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:59.965381 (+ 2085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:59.965964 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:35:59.966114 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:59.970964 (+ 4850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:35:59.970976 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:35:59.970979 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:35:59.971013 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:35:59.975859 (+ 4846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:59.976668 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:59.976674 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:59.976677 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:59.976866 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:35:59.977453 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:35:59.977459 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:35:59.977463 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:35:59.977800 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:35:59.977962 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 08:35:59.978814 (+ 852us) server_negotiation.cc:299] Negotiation successful
0808 08:35:59.979046 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":931,"thread_start_us":760,"threads_started":1}
I20260808 08:35:59.980985 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:59.954545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:35553 (local address 127.5.164.195:36239)
0808 08:35:59.956116 (+ 1571us) negotiation.cc:107] Waiting for socket to connect
0808 08:35:59.956169 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:35:59.958974 (+ 2805us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:35:59.960080 (+ 1106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:35:59.960093 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:35:59.960878 (+ 785us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:35:59.962106 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:59.962128 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:59.963453 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:59.963457 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:59.965235 (+ 1778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:35:59.965248 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:35:59.966350 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:35:59.966361 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:35:59.966642 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:35:59.967586 (+ 944us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:35:59.967617 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:35:59.970697 (+ 3080us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:35:59.976008 (+ 5311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:35:59.976017 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:35:59.976036 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:35:59.976520 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:35:59.976989 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:35:59.976994 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:35:59.976998 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:35:59.977329 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:35:59.977937 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:35:59.977946 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:35:59.978371 (+ 425us) client_negotiation.cc:769] Sending connection context
0808 08:35:59.978738 (+ 367us) client_negotiation.cc:240] Negotiation successful
0808 08:35:59.979413 (+ 675us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1178,"thread_start_us":883,"threads_started":1}
I20260808 08:35:59.982877 18642 heartbeater.cc:347] Connected to a master server at 127.5.164.254:35553
I20260808 08:35:59.983319 18642 heartbeater.cc:464] Registering TS with master...
I20260808 08:35:59.984360 18642 heartbeater.cc:511] Master 127.5.164.254:35553 requested a full tablet report, sending...
I20260808 08:35:59.986752 18112 ts_manager.cc:194] Registered new tserver with Master: 9c004b1dd0bb479aa19d6362f35a5744 (127.5.164.195:36681)
I20260808 08:35:59.988298 18112 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:36239
I20260808 08:35:59.988745 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:36:00.014909 18644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:35:59.995489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60120 (local address 127.5.164.254:35553)
0808 08:35:59.995738 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 08:35:59.995747 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:35:59.996391 (+ 644us) server_negotiation.cc:407] Connection header received
0808 08:35:59.996585 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:35:59.996589 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:35:59.996702 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:35:59.996788 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:35:59.998952 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:35:59.999962 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.001886 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.002659 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.002774 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:00.006431 (+ 3657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:00.006438 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:00.006443 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:00.006521 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:00.010993 (+ 4472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:00.011973 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:00.011979 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:00.011984 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:00.012199 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:00.012775 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:00.012783 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:00.012789 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:00.013182 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:00.013662 (+ 480us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:00.014047 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 08:36:00.014421 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:36:00.020745 18112 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60120:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:36:00.031529 18112 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:36:00.059028 18498 heartbeater.cc:503] Master 127.5.164.254:35553 was elected leader, sending a full tablet report...
I20260808 08:36:00.084944 18660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:00.049814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:41267 (local address 127.0.0.1:59486)
0808 08:36:00.064941 (+ 15127us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:00.064998 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:36:00.065235 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:36:00.069013 (+ 3778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:36:00.069032 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:36:00.069131 (+ 99us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:36:00.072534 (+ 3403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:00.072581 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.075795 (+ 3214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.075800 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:00.080568 (+ 4768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:00.080584 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.083461 (+ 2877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.083469 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:00.083753 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:00.083807 (+ 54us) client_negotiation.cc:769] Sending connection context
0808 08:36:00.084008 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 08:36:00.084352 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14867,"thread_start_us":23709,"threads_started":1}
I20260808 08:36:00.084977 18656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:00.050385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59486 (local address 127.5.164.194:41267)
0808 08:36:00.067255 (+ 16870us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:00.067269 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:00.067309 (+ 40us) server_negotiation.cc:407] Connection header received
0808 08:36:00.067428 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:00.067440 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:00.068318 (+ 878us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:00.068596 (+ 278us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:36:00.073161 (+ 4565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.075584 (+ 2423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.080806 (+ 5222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.083104 (+ 2298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.083369 (+ 265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:00.083763 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:00.084116 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 08:36:00.084389 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15588,"thread_start_us":15278,"threads_started":1}
I20260808 08:36:00.086010 18659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:00.051056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:40919 (local address 127.0.0.1:33304)
0808 08:36:00.071239 (+ 20183us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:00.071271 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 08:36:00.071453 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:36:00.072467 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:36:00.072473 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:36:00.072552 (+ 79us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:36:00.073885 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:00.073896 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.076903 (+ 3007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.076909 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:00.080704 (+ 3795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:00.080717 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.084447 (+ 3730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.084456 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:00.084799 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:00.084833 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:36:00.084954 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 08:36:00.085131 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19930,"mutex_wait_us":2,"spinlock_wait_cycles":114560,"thread_start_us":19578,"threads_started":1}
I20260808 08:36:00.086089 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:00.050846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45526 (local address 127.5.164.195:36681)
0808 08:36:00.071307 (+ 20461us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:00.071319 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:00.073306 (+ 1987us) server_negotiation.cc:407] Connection header received
0808 08:36:00.073643 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:00.073652 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:00.073961 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:00.074213 (+ 252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:36:00.076260 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.077962 (+ 1702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.081689 (+ 3727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.083488 (+ 1799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.083644 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:00.083998 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:00.085204 (+ 1206us) server_negotiation.cc:299] Negotiation successful
0808 08:36:00.085424 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20089,"thread_start_us":20473,"threads_started":1}
I20260808 08:36:00.086997 18657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:00.051194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:36681 (local address 127.0.0.1:45526)
0808 08:36:00.073110 (+ 21916us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:00.073147 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 08:36:00.073359 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:36:00.074204 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:36:00.074209 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:36:00.074254 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:36:00.075841 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:00.075861 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.078182 (+ 2321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.078190 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:00.081541 (+ 3351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:00.081553 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.084558 (+ 3005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.084565 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:00.084819 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:00.084887 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 08:36:00.084999 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 08:36:00.086316 (+ 1317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21607,"mutex_wait_us":1138,"thread_start_us":13156,"threads_started":1}
I20260808 08:36:00.087316 18662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:00.051730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33304 (local address 127.5.164.193:40919)
0808 08:36:00.068623 (+ 16893us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:00.068632 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:00.071631 (+ 2999us) server_negotiation.cc:407] Connection header received
0808 08:36:00.071787 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:00.071794 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:00.072062 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:00.072411 (+ 349us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:36:00.074050 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.076634 (+ 2584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.080877 (+ 4243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.083427 (+ 2550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.083606 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:00.083949 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:00.086539 (+ 2590us) server_negotiation.cc:299] Negotiation successful
0808 08:36:00.086790 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16640,"thread_start_us":16850,"threads_started":1}
I20260808 08:36:00.090432 18429 tablet_service.cc:1467] Processing CreateTablet for tablet 33f78ff1577142d3a6e98a6b59d9470a (DEFAULT_TABLE table=test-table [id=be3d319477964a7a8a59bb949fc9a289]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:36:00.092331 18429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33f78ff1577142d3a6e98a6b59d9470a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:36:00.091922 18571 tablet_service.cc:1467] Processing CreateTablet for tablet 33f78ff1577142d3a6e98a6b59d9470a (DEFAULT_TABLE table=test-table [id=be3d319477964a7a8a59bb949fc9a289]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:36:00.091974 18272 tablet_service.cc:1467] Processing CreateTablet for tablet 33f78ff1577142d3a6e98a6b59d9470a (DEFAULT_TABLE table=test-table [id=be3d319477964a7a8a59bb949fc9a289]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:36:00.094182 18571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33f78ff1577142d3a6e98a6b59d9470a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:36:00.094244 18272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33f78ff1577142d3a6e98a6b59d9470a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:36:00.110139 18663 tablet_bootstrap.cc:492] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c: Bootstrap starting.
I20260808 08:36:00.115500 18663 tablet_bootstrap.cc:654] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c: Neither blocks nor log segments found. Creating new log.
I20260808 08:36:00.116788 18664 tablet_bootstrap.cc:492] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38: Bootstrap starting.
I20260808 08:36:00.118505 18663 log.cc:824] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:36:00.123696 18665 tablet_bootstrap.cc:492] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744: Bootstrap starting.
I20260808 08:36:00.123798 18663 tablet_bootstrap.cc:492] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c: No bootstrap required, opened a new log
I20260808 08:36:00.124138 18663 ts_tablet_manager.cc:1397] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.010s
I20260808 08:36:00.124606 18664 tablet_bootstrap.cc:654] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38: Neither blocks nor log segments found. Creating new log.
I20260808 08:36:00.127596 18664 log.cc:824] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38: Log is configured to *not* fsync() on all Append() calls
I20260808 08:36:00.128964 18665 tablet_bootstrap.cc:654] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744: Neither blocks nor log segments found. Creating new log.
I20260808 08:36:00.131990 18665 log.cc:824] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744: Log is configured to *not* fsync() on all Append() calls
I20260808 08:36:00.133369 18664 tablet_bootstrap.cc:492] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38: No bootstrap required, opened a new log
I20260808 08:36:00.133759 18664 ts_tablet_manager.cc:1397] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.005s
I20260808 08:36:00.137383 18665 tablet_bootstrap.cc:492] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744: No bootstrap required, opened a new log
I20260808 08:36:00.137813 18665 ts_tablet_manager.cc:1397] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.005s
I20260808 08:36:00.139320 18663 raft_consensus.cc:348] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4481c053f190452cae92a41f8041f06c" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41267 } } peers { permanent_uuid: "9c004b1dd0bb479aa19d6362f35a5744" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36681 } } peers { permanent_uuid: "bd75a56311654f90bf66a1d97c817d38" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 40919 } }
I20260808 08:36:00.139801 18663 raft_consensus.cc:374] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:36:00.140007 18663 raft_consensus.cc:729] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4481c053f190452cae92a41f8041f06c, State: Initialized, Role: FOLLOWER
I20260808 08:36:00.140812 18663 consensus_queue.cc:260] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4481c053f190452cae92a41f8041f06c" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41267 } } peers { permanent_uuid: "9c004b1dd0bb479aa19d6362f35a5744" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36681 } } peers { permanent_uuid: "bd75a56311654f90bf66a1d97c817d38" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 40919 } }
I20260808 08:36:00.143761 18663 ts_tablet_manager.cc:1428] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c: Time spent starting tablet: real 0.019s user 0.013s sys 0.007s
I20260808 08:36:00.150934 18664 raft_consensus.cc:348] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4481c053f190452cae92a41f8041f06c" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41267 } } peers { permanent_uuid: "9c004b1dd0bb479aa19d6362f35a5744" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36681 } } peers { permanent_uuid: "bd75a56311654f90bf66a1d97c817d38" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 40919 } }
I20260808 08:36:00.151690 18664 raft_consensus.cc:374] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:36:00.151912 18664 raft_consensus.cc:729] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd75a56311654f90bf66a1d97c817d38, State: Initialized, Role: FOLLOWER
I20260808 08:36:00.152909 18664 consensus_queue.cc:260] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4481c053f190452cae92a41f8041f06c" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41267 } } peers { permanent_uuid: "9c004b1dd0bb479aa19d6362f35a5744" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36681 } } peers { permanent_uuid: "bd75a56311654f90bf66a1d97c817d38" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 40919 } }
I20260808 08:36:00.154791 18665 raft_consensus.cc:348] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4481c053f190452cae92a41f8041f06c" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41267 } } peers { permanent_uuid: "9c004b1dd0bb479aa19d6362f35a5744" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36681 } } peers { permanent_uuid: "bd75a56311654f90bf66a1d97c817d38" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 40919 } }
I20260808 08:36:00.155438 18665 raft_consensus.cc:374] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:36:00.155654 18665 raft_consensus.cc:729] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c004b1dd0bb479aa19d6362f35a5744, State: Initialized, Role: FOLLOWER
I20260808 08:36:00.156051 18664 ts_tablet_manager.cc:1428] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38: Time spent starting tablet: real 0.022s user 0.018s sys 0.006s
I20260808 08:36:00.156414 18665 consensus_queue.cc:260] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4481c053f190452cae92a41f8041f06c" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41267 } } peers { permanent_uuid: "9c004b1dd0bb479aa19d6362f35a5744" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36681 } } peers { permanent_uuid: "bd75a56311654f90bf66a1d97c817d38" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 40919 } }
I20260808 08:36:00.158684 18642 heartbeater.cc:503] Master 127.5.164.254:35553 was elected leader, sending a full tablet report...
I20260808 08:36:00.159122 18665 ts_tablet_manager.cc:1428] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744: Time spent starting tablet: real 0.021s user 0.007s sys 0.016s
W20260808 08:36:00.166148 18345 tablet.cc:2369] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:36:00.203197 18643 tablet.cc:2369] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:36:00.262152 18499 tablet.cc:2369] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:36:00.370795 18669 raft_consensus.cc:482] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:36:00.371433 18669 raft_consensus.cc:504] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4481c053f190452cae92a41f8041f06c" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41267 } } peers { permanent_uuid: "9c004b1dd0bb479aa19d6362f35a5744" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36681 } } peers { permanent_uuid: "bd75a56311654f90bf66a1d97c817d38" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 40919 } }
I20260808 08:36:00.373852 18669 leader_election.cc:288] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c004b1dd0bb479aa19d6362f35a5744 (127.5.164.195:36681), bd75a56311654f90bf66a1d97c817d38 (127.5.164.193:40919)
I20260808 08:36:00.386476 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:00.374322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:43237 (local address 127.5.164.195:36681)
0808 08:36:00.374616 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:00.374623 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:00.376338 (+ 1715us) server_negotiation.cc:407] Connection header received
0808 08:36:00.376832 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:00.376839 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:00.376951 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:00.377020 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:36:00.378365 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.379726 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.383356 (+ 3630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.385246 (+ 1890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.385433 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:00.385501 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:00.386103 (+ 602us) server_negotiation.cc:299] Negotiation successful
0808 08:36:00.386227 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131}
I20260808 08:36:00.387243 18672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:00.374057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:36681 (local address 127.5.164.194:43237)
0808 08:36:00.375913 (+ 1856us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:00.375942 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:36:00.376548 (+ 606us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:36:00.377306 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:36:00.377313 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:36:00.377392 (+ 79us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:36:00.378190 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:00.378207 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.379873 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.379880 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:00.383109 (+ 3229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:00.383122 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.385580 (+ 2458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.385587 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:00.385869 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:00.385922 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 08:36:00.386049 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 08:36:00.386252 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1582,"mutex_wait_us":26,"thread_start_us":1054,"threads_started":1}
I20260808 08:36:00.388290 18662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:00.374329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:34035 (local address 127.5.164.193:40919)
0808 08:36:00.374686 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:00.374707 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:00.377231 (+ 2524us) server_negotiation.cc:407] Connection header received
0808 08:36:00.377556 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:00.377561 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:00.377624 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:00.377751 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:36:00.379308 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.380978 (+ 1670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.385008 (+ 4030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.386659 (+ 1651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.386919 (+ 260us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:00.387033 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:00.387858 (+ 825us) server_negotiation.cc:299] Negotiation successful
0808 08:36:00.388014 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 08:36:00.388614 18673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:00.375026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:40919 (local address 127.5.164.194:34035)
0808 08:36:00.376921 (+ 1895us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:00.376945 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:36:00.377341 (+ 396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:36:00.377753 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:36:00.377758 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:36:00.377782 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:36:00.379085 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:00.379102 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.381186 (+ 2084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.381190 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:00.384773 (+ 3583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:00.384790 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.387388 (+ 2598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.387400 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:00.387648 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:00.387683 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 08:36:00.387761 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 08:36:00.387863 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1676,"mutex_wait_us":20,"thread_start_us":1298,"threads_started":1}
I20260808 08:36:00.389020 18592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33f78ff1577142d3a6e98a6b59d9470a" candidate_uuid: "4481c053f190452cae92a41f8041f06c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c004b1dd0bb479aa19d6362f35a5744" is_pre_election: true
I20260808 08:36:00.389726 18592 raft_consensus.cc:2454] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4481c053f190452cae92a41f8041f06c in term 0.
I20260808 08:36:00.390435 18296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33f78ff1577142d3a6e98a6b59d9470a" candidate_uuid: "4481c053f190452cae92a41f8041f06c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd75a56311654f90bf66a1d97c817d38" is_pre_election: true
I20260808 08:36:00.390702 18381 leader_election.cc:302] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4481c053f190452cae92a41f8041f06c, 9c004b1dd0bb479aa19d6362f35a5744; no voters:
I20260808 08:36:00.391601 18669 raft_consensus.cc:2781] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:36:00.391332 18296 raft_consensus.cc:2454] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4481c053f190452cae92a41f8041f06c in term 0.
I20260808 08:36:00.391908 18669 raft_consensus.cc:482] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:36:00.392095 18669 raft_consensus.cc:3037] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:36:00.395996 18669 raft_consensus.cc:504] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4481c053f190452cae92a41f8041f06c" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41267 } } peers { permanent_uuid: "9c004b1dd0bb479aa19d6362f35a5744" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36681 } } peers { permanent_uuid: "bd75a56311654f90bf66a1d97c817d38" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 40919 } }
I20260808 08:36:00.397015 18669 leader_election.cc:288] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [CANDIDATE]: Term 1 election: Requested vote from peers 9c004b1dd0bb479aa19d6362f35a5744 (127.5.164.195:36681), bd75a56311654f90bf66a1d97c817d38 (127.5.164.193:40919)
I20260808 08:36:00.397791 18296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33f78ff1577142d3a6e98a6b59d9470a" candidate_uuid: "4481c053f190452cae92a41f8041f06c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd75a56311654f90bf66a1d97c817d38"
I20260808 08:36:00.397814 18592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33f78ff1577142d3a6e98a6b59d9470a" candidate_uuid: "4481c053f190452cae92a41f8041f06c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c004b1dd0bb479aa19d6362f35a5744"
I20260808 08:36:00.398104 18296 raft_consensus.cc:3037] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:36:00.398166 18592 raft_consensus.cc:3037] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:36:00.401768 18592 raft_consensus.cc:2454] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4481c053f190452cae92a41f8041f06c in term 1.
I20260808 08:36:00.401836 18296 raft_consensus.cc:2454] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4481c053f190452cae92a41f8041f06c in term 1.
I20260808 08:36:00.402417 18381 leader_election.cc:302] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4481c053f190452cae92a41f8041f06c, 9c004b1dd0bb479aa19d6362f35a5744; no voters:
I20260808 08:36:00.402856 18669 raft_consensus.cc:2781] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:36:00.403924 18669 raft_consensus.cc:686] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [term 1 LEADER]: Becoming Leader. State: Replica: 4481c053f190452cae92a41f8041f06c, State: Running, Role: LEADER
I20260808 08:36:00.404834 18669 consensus_queue.cc:237] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4481c053f190452cae92a41f8041f06c" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41267 } } peers { permanent_uuid: "9c004b1dd0bb479aa19d6362f35a5744" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36681 } } peers { permanent_uuid: "bd75a56311654f90bf66a1d97c817d38" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 40919 } }
I20260808 08:36:00.411482 18111 catalog_manager.cc:5495] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c reported cstate change: term changed from 0 to 1, leader changed from <none> to 4481c053f190452cae92a41f8041f06c (127.5.164.194). New cstate: current_term: 1 leader_uuid: "4481c053f190452cae92a41f8041f06c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4481c053f190452cae92a41f8041f06c" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c004b1dd0bb479aa19d6362f35a5744" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd75a56311654f90bf66a1d97c817d38" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 40919 } health_report { overall_health: UNKNOWN } } }
I20260808 08:36:00.465273 18656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:00.457994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59488 (local address 127.5.164.194:41267)
0808 08:36:00.458283 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:00.458290 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:00.458467 (+ 177us) server_negotiation.cc:407] Connection header received
0808 08:36:00.458705 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:00.458710 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:00.458807 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:00.458991 (+ 184us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:36:00.459517 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.460759 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.462440 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.462935 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.463050 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:00.463767 (+ 717us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:36:00.464360 (+ 593us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:36:00.464471 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:00.464722 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 08:36:00.464798 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 08:36:00.476912 18296 raft_consensus.cc:1261] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38 [term 1 FOLLOWER]: Refusing update from remote peer 4481c053f190452cae92a41f8041f06c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:36:00.476954 18592 raft_consensus.cc:1261] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744 [term 1 FOLLOWER]: Refusing update from remote peer 4481c053f190452cae92a41f8041f06c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:36:00.478173 18674 consensus_queue.cc:1035] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd75a56311654f90bf66a1d97c817d38" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 40919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:36:00.478839 18669 consensus_queue.cc:1035] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c004b1dd0bb479aa19d6362f35a5744" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:36:00.496425 18677 mvcc.cc:205] Tried to move back new op lower bound from 7316185745300992000 to 7316185745023143936. Current Snapshot: MvccSnapshot[applied={T|T < 7316185745300992000}]
I20260808 08:36:00.517613 18111 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60120:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:36:00.518149 18111 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60120:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:36:00.522547 18111 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5b23c78607954ef9be144cadb6aa7d64: Sending DeleteTablet for 3 replicas of tablet 33f78ff1577142d3a6e98a6b59d9470a
I20260808 08:36:00.524016 18571 tablet_service.cc:1514] Processing DeleteTablet for tablet 33f78ff1577142d3a6e98a6b59d9470a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:36:00 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:45526
I20260808 08:36:00.524541 18272 tablet_service.cc:1514] Processing DeleteTablet for tablet 33f78ff1577142d3a6e98a6b59d9470a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:36:00 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:33304
I20260808 08:36:00.524585 18429 tablet_service.cc:1514] Processing DeleteTablet for tablet 33f78ff1577142d3a6e98a6b59d9470a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:36:00 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:59486
I20260808 08:36:00.527947 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 18199
I20260808 08:36:00.540517 18687 tablet_replica.cc:330] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744: stopping tablet replica
I20260808 08:36:00.541280 18687 raft_consensus.cc:2229] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:36:00.542539 18687 raft_consensus.cc:2258] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:36:00.543720 18688 tablet_replica.cc:330] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38: stopping tablet replica
I20260808 08:36:00.544190 18688 raft_consensus.cc:2229] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:36:00.544486 18689 tablet_replica.cc:330] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c: stopping tablet replica
I20260808 08:36:00.544747 18688 raft_consensus.cc:2258] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:36:00.544875 18689 raft_consensus.cc:2229] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:36:00.545588 18689 raft_consensus.cc:2258] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:36:00.547082 18688 ts_tablet_manager.cc:1905] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:36:00.549269 18689 ts_tablet_manager.cc:1905] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:36:00.554960 18687 ts_tablet_manager.cc:1905] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:36:00.557443 18689 ts_tablet_manager.cc:1918] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:36:00.557667 18688 ts_tablet_manager.cc:1918] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:36:00.557909 18689 log.cc:1196] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/33f78ff1577142d3a6e98a6b59d9470a
I20260808 08:36:00.558029 18688 log.cc:1196] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/33f78ff1577142d3a6e98a6b59d9470a
I20260808 08:36:00.558956 18689 ts_tablet_manager.cc:1939] T 33f78ff1577142d3a6e98a6b59d9470a P 4481c053f190452cae92a41f8041f06c: Deleting consensus metadata
I20260808 08:36:00.559033 18688 ts_tablet_manager.cc:1939] T 33f78ff1577142d3a6e98a6b59d9470a P bd75a56311654f90bf66a1d97c817d38: Deleting consensus metadata
Aug 08 08:36:00 dist-test-slave-chsk krb5kdc[17605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178154, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:36:00.561512 18096 catalog_manager.cc:4841] TS bd75a56311654f90bf66a1d97c817d38 (127.5.164.193:40919): tablet 33f78ff1577142d3a6e98a6b59d9470a (table test-table [id=be3d319477964a7a8a59bb949fc9a289]) successfully deleted
I20260808 08:36:00.561566 18099 catalog_manager.cc:4841] TS 4481c053f190452cae92a41f8041f06c (127.5.164.194:41267): tablet 33f78ff1577142d3a6e98a6b59d9470a (table test-table [id=be3d319477964a7a8a59bb949fc9a289]) successfully deleted
I20260808 08:36:00.562871 18687 ts_tablet_manager.cc:1918] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:36:00.563170 18687 log.cc:1196] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/33f78ff1577142d3a6e98a6b59d9470a
I20260808 08:36:00.564047 18687 ts_tablet_manager.cc:1939] T 33f78ff1577142d3a6e98a6b59d9470a P 9c004b1dd0bb479aa19d6362f35a5744: Deleting consensus metadata
I20260808 08:36:00.566455 18097 catalog_manager.cc:4841] TS 9c004b1dd0bb479aa19d6362f35a5744 (127.5.164.195:36681): tablet 33f78ff1577142d3a6e98a6b59d9470a (table test-table [id=be3d319477964a7a8a59bb949fc9a289]) successfully deleted
I20260808 08:36:00.570952 18662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:00.532145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33318 (local address 127.5.164.193:40919)
0808 08:36:00.532338 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:00.532346 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:00.543341 (+ 10995us) server_negotiation.cc:407] Connection header received
0808 08:36:00.543977 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:00.543983 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:00.544096 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:00.544231 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:00.547054 (+ 2823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.548388 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.551031 (+ 2643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.551777 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.551880 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:00.562135 (+ 10255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:00.562147 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:00.562161 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:00.562228 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:00.567062 (+ 4834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:00.568289 (+ 1227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:00.568296 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:00.568299 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:00.568426 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:00.569089 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:00.569092 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:00.569094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:00.569651 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:00.569920 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:00.570329 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 08:36:00.570526 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:36:00.571947 18338 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:36:00.667449 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 18199
I20260808 08:36:00.689234 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 18351
Aug 08 08:36:00 dist-test-slave-chsk krb5kdc[17605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178154, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:36:00.708372 18656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:00.690166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59492 (local address 127.5.164.194:41267)
0808 08:36:00.690363 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:00.690367 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:00.690389 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:36:00.690605 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:00.690609 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:00.690676 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:00.690762 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:00.692708 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.693542 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.695694 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.696158 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.696259 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:00.701613 (+ 5354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:00.701631 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:00.701647 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:00.701694 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:00.704932 (+ 3238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:00.705724 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:00.705732 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:00.705734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:00.705960 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:00.706465 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:00.706470 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:00.706472 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:00.706987 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:00.707343 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:00.707669 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 08:36:00.707934 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:36:00.709363 18493 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:36:00.837780 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 18351
I20260808 08:36:00.859915 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 18505
Aug 08 08:36:00 dist-test-slave-chsk krb5kdc[17605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178154, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:36:00.875944 18658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:00.860727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45530 (local address 127.5.164.195:36681)
0808 08:36:00.860940 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:00.860949 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:00.861013 (+ 64us) server_negotiation.cc:407] Connection header received
0808 08:36:00.861274 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:00.861278 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:00.861342 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:00.861467 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:00.862885 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.863677 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.864971 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:00.865388 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:00.865522 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:00.869958 (+ 4436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:00.869972 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:00.869990 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:00.870023 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:00.872832 (+ 2809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:00.873556 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:00.873564 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:00.873566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:00.873697 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:00.874076 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:00.874081 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:00.874084 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:00.874451 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:00.874762 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:00.875084 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 08:36:00.875661 (+ 577us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 08:36:00.876647 18636 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:36:00.970166 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 18505
I20260808 08:36:00.990447 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 18079
I20260808 08:36:00.991739 18145 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:36:01.108870 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 18079
I20260808 08:36:01.142088 5779 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 08:36:01.477525 5779 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 08:36:01.477855 5779 mini_ranger.cc:66] Stopping Ranger...
I20260808 08:36:01.823956 5779 mini_ranger.cc:68] Stopped Ranger
2026-08-08 08:36:01.824 UTC [17637] LOG: received smart shutdown request
2026-08-08 08:36:01.827 UTC [17637] LOG: background worker "logical replication launcher" (PID 17648) exited with exit code 1
2026-08-08 08:36:01.827 UTC [17641] LOG: shutting down
2026-08-08 08:36:02.001 UTC [17637] LOG: database system is shut down
2026-08-08T08:36:02Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (54018 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:36:02 dist-test-slave-chsk krb5kdc[18703](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:36:02 dist-test-slave-chsk krb5kdc[18703](info): set up 2 sockets
Aug 08 08:36:02 dist-test-slave-chsk krb5kdc[18703](info): commencing operation
krb5kdc: starting...
W20260808 08:36:03.318773 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:36:03 dist-test-slave-chsk krb5kdc[18703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178163, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:36:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:36:03Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.5.164.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.5.164.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.5.164.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/rangeradmin_127.5.164.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.5.164.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/rangeradmin_127.5.164.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.5.164.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.5.164.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.5.164.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/rangerlookup_127.5.164.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.5.164.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/rangerlookup_127.5.164.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.5.164.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.5.164.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.164.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/HTTP_127.5.164.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.5.164.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/HTTP_127.5.164.212@KRBTEST.COM.keytab.
I20260808 08:36:03.729988 5779 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskp0Id9M/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/postgres -l logfile start
2026-08-08 08:36:06.285 UTC [18735] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 08:36:06.285 UTC [18735] LOG: listening on IPv4 address "127.5.164.212", port 40935
2026-08-08 08:36:06.289 UTC [18735] LOG: listening on Unix socket "/tmp/.s.PGSQL.40935"
2026-08-08 08:36:06.313 UTC [18739] LOG: database system was shut down at 2026-08-08 08:36:04 UTC
2026-08-08 08:36:06.317 UTC [18735] LOG: database system is ready to accept connections
I20260808 08:36:07.336930 5779 mini_postgres.cc:96] Postgres bound to 40935
2026-08-08 08:36:07.360 UTC [18750] FATAL: database "slave" does not exist
127.5.164.212:40935 - accepting connections
I20260808 08:36:07.361320 5779 mini_ranger.cc:161] Starting Ranger...
I20260808 08:36:07.392828 5779 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 08:36:07.896554 5779 mini_ranger.cc:87] Created ranger Postgres database
I20260808 08:36:07.896689 5779 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-admin
2026-08-08 08:36:08,192 [I] DB FLAVOR :POSTGRES
2026-08-08 08:36:08,193 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 08:36:08,193 [I] Checking connection..
2026-08-08 08:36:08,193 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 08:36:08,463 [I] Checking connection passed.
2026-08-08 08:36:08,463 [I] --------- Verifying version history table ---------
2026-08-08 08:36:08,463 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:36:08,739 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 08:36:08,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:36:08,988 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 08:36:08,989 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 08:36:08,989 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 08:36:09.247 UTC [18818] WARNING: there is no transaction in progress
2026-08-08 08:36:09,254 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 08:36:09,255 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 08:36:09,504 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 08:36:09,504 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 08:36:09,505 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 08:36:09,774 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 08:36:10,035 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-chsk.c.gcp-upstream.internal','N') ;"
2026-08-08 08:36:10,277 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 08:36:10,556 [I] Table x_portal_user does not exist in database ranger
2026-08-08 08:36:10,556 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 08:36:10,819 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 08:36:10,820 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 08:36:11,099 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 08:36:11,364 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 08:36:11,364 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 08:36:12.347 UTC [18935] WARNING: there is no transaction in progress
2026-08-08 08:36:12.363 UTC [18935] WARNING: there is no transaction in progress
2026-08-08 08:36:12.379 UTC [18935] WARNING: there is no transaction in progress
2026-08-08 08:36:12.394 UTC [18935] WARNING: there is no transaction in progress
2026-08-08 08:36:12.410 UTC [18935] WARNING: there is no transaction in progress
2026-08-08 08:36:12.428 UTC [18935] WARNING: there is no transaction in progress
2026-08-08 08:36:12.480 UTC [18935] WARNING: there is no transaction in progress
2026-08-08 08:36:12.487 UTC [18935] WARNING: there is no transaction in progress
2026-08-08 08:36:12.501 UTC [18935] WARNING: there is no transaction in progress
2026-08-08 08:36:12.511 UTC [18935] WARNING: there is no transaction in progress
2026-08-08 08:36:12.521 UTC [18935] WARNING: there is no transaction in progress
2026-08-08 08:36:12.535 UTC [18935] WARNING: there is no transaction in progress
2026-08-08 08:36:12.545 UTC [18935] WARNING: there is no transaction in progress
2026-08-08 08:36:12.552 UTC [18935] WARNING: there is no transaction in progress
2026-08-08 08:36:12.558 UTC [18935] WARNING: there is no transaction in progress
2026-08-08 08:36:12.565 UTC [18935] WARNING: there is no transaction in progress
2026-08-08 08:36:13,249 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 08:36:13,249 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 08:36:13,491 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 08:36:13,491 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 08:36:13,763 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 08:36:13,763 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 08:36:14,021 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 08:36:14,021 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 08:36:14,294 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 08:36:14,564 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-chsk.c.gcp-upstream.internal';"
2026-08-08 08:36:14,830 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 08:36:14,831 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 08:36:15,095 [I] DB_PATCHES have already been applied
I20260808 08:36:15.102146 5779 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-admin:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskp0Id9M/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 08:36:15.102232 5779 mini_ranger.cc:193] Using host: 127.5.164.212
I20260808 08:36:15.123971 5779 mini_ranger.cc:227] Ranger admin URL: http://127.5.164.212:60589
Aug 08, 2026 8:36:15 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 8:36:15 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 8:36:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 8:36:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 8:36:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 8:36:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 8:36:16 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 08:36:16.303891 5779 mini_ranger.cc:160] Time spent starting Ranger: real 8.943s user 0.003s sys 0.054s
Aug 08, 2026 8:36:38 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 8:36:38 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 8:36:38 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 8:36:38 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 8:36:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 8:36:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 8:36:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 8:36:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 8:36:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 8:36:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 8:36:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 8:36:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 8:36:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 8:36:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 8:36:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 8:36:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 8:36:38 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 8:36:39 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 08:36:39.938195 5779 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.5.164.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.5.164.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.5.164.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/rangerkms_127.5.164.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.5.164.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/rangerkms_127.5.164.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.5.164.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.5.164.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.5.164.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/HTTP_127.5.164.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.5.164.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/HTTP_127.5.164.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 08:36:40 dist-test-slave-chsk krb5kdc[18703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178200, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 08:36:40.171133 5779 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 08:36:40.198918 5779 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 08:36:41.106288 5779 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 08:36:41.106423 5779 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-kms
I20260808 08:36:41.106463 5779 mini_ranger_kms.cc:227] Using postgres at 127.5.164.212:40935
2026-08-08 08:36:41,508 [I] DB FLAVOR :POSTGRES
2026-08-08 08:36:41,508 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 08:36:41,509 [I] Checking connection
2026-08-08 08:36:41,509 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 08:36:41,760 [I] connection success
2026-08-08 08:36:41,761 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 08:36:41,761 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 08:36:41,761 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 08:36:42,046 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 08:36:42,047 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 08:36:42,047 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 08:36:42,047 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.5.164.212:40935/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 08:36:42,353 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 08:36:42.880738 5779 mini_ranger_kms.cc:310] Created kms service
I20260808 08:36:43.055128 5779 mini_ranger_kms.cc:326] Created kudu user
I20260808 08:36:43.102825 5779 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 08:36:43 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178200, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
I20260808 08:36:43.520581 5779 mini_ranger_kms.cc:384] Added ranger policy
I20260808 08:36:43.520938 5779 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-kms:/tmp/dist-test-taskp0Id9M/build/asan/bin/postgresql.jar:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskp0Id9M/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 08:36:43.520989 5779 mini_ranger_kms.cc:240] Using host: 127.5.164.212
I20260808 08:36:43.544369 5779 mini_ranger_kms.cc:276] Ranger KMS PID: 19135
I20260808 08:36:43.544502 5779 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.5.164.212:44723
Aug 08, 2026 8:36:44 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 8:36:44 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 8:36:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 8:36:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 8:36:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 8:36:45 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 08:36:45.894039 5779 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.723s user 0.079s sys 0.356s
I20260808 08:36:45.894304 5779 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 08:36:45.894466 5779 mini_ranger_kms.cc:401] 127.5.164.212:44723/kms/v1/keys
Aug 08 08:36:45 dist-test-slave-chsk krb5kdc[18703](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786178205, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.164.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 08:36:46 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178205, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.164.212@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
Aug 08 08:36:46 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178205, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.5.164.212@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
Aug 08 08:36:49 dist-test-slave-chsk krb5kdc[18703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:36:49.163713 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:42899
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:45561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:42899
--ranger_config_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.164.212:44723/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:36:49.556484 19188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:36:49.556973 19188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:36:49.557221 19188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:36:49.567131 19188 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:36:49.567421 19188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:36:49.567589 19188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:36:49.567792 19188 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:36:49.567983 19188 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:36:49.581840 19188 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/wal
--ranger_kms_url=127.5.164.212:44723/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:42899
--ranger_config_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:42899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:36:49.583508 19188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:36:49.585204 19188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:36:49.601413 19196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:36:49.601320 19193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:36:49.602013 19198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:36:49.602481 19188 server_base.cc:1034] running on GCE node
I20260808 08:36:49.603612 19188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:36:49.605480 19188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:36:49.606789 19188 hybrid_clock.cc:648] HybridClock initialized: now 1786178209606679 us; error 50 us; skew 500 ppm
I20260808 08:36:49.607304 19188 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:36:49 dist-test-slave-chsk krb5kdc[18703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178209, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:36:49.615727 19188 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:36:49.617980 19188 webserver.cc:460] Webserver started at http://127.5.164.254:46169/ using document root <none> and password file <none>
I20260808 08:36:49.618886 19188 fs_manager.cc:359] Metadata directory not provided
I20260808 08:36:49.619077 19188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:36:49.619486 19188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:36:49 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178209, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
I20260808 08:36:49.677299 19188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "fabcf28e375b460e9adb414e440d947c"
format_stamp: "Formatted at 2026-08-08 08:36:49 on dist-test-slave-chsk"
server_key: "4d0b8a6177510cbbe077095e8c7f6410"
server_key_iv: "9a2642c71e1faf58eed04876c132b3ff"
server_key_version: "kuduclusterkey@0"
I20260808 08:36:49.678648 19188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "fabcf28e375b460e9adb414e440d947c"
format_stamp: "Formatted at 2026-08-08 08:36:49 on dist-test-slave-chsk"
server_key: "4d0b8a6177510cbbe077095e8c7f6410"
server_key_iv: "9a2642c71e1faf58eed04876c132b3ff"
server_key_version: "kuduclusterkey@0"
I20260808 08:36:49.686565 19188 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.005s
I20260808 08:36:49.706864 19207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:49.708657 19188 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260808 08:36:49.708906 19188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "fabcf28e375b460e9adb414e440d947c"
format_stamp: "Formatted at 2026-08-08 08:36:49 on dist-test-slave-chsk"
server_key: "4d0b8a6177510cbbe077095e8c7f6410"
server_key_iv: "9a2642c71e1faf58eed04876c132b3ff"
server_key_version: "kuduclusterkey@0"
I20260808 08:36:49.709215 19188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:36:49.738602 19188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:36:49.744529 19188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:36:49.745105 19188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:36:49.786028 19188 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:42899
I20260808 08:36:49.786163 19260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:42899 every 8 connection(s)
I20260808 08:36:49.787683 19188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:36:49.788533 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 19188
I20260808 08:36:49.788796 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:36:49.790069 5779 external_mini_cluster.cc:1428] Setting key 6721a04b5d7b2691ca5d2374a6554e3a
I20260808 08:36:49.794497 19261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:36:49.808153 19261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c: Bootstrap starting.
Aug 08 08:36:49 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:36:49.813529 19261 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c: Neither blocks nor log segments found. Creating new log.
I20260808 08:36:49.815795 19261 log.cc:824] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:36:49.820376 19261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c: No bootstrap required, opened a new log
I20260808 08:36:49.820956 19264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:49.792495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42738 (local address 127.5.164.254:42899)
0808 08:36:49.794868 (+ 2373us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:49.794881 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:49.794948 (+ 67us) server_negotiation.cc:407] Connection header received
0808 08:36:49.797410 (+ 2462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:49.797435 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:49.797878 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:49.798377 (+ 499us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:49.800213 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:49.802060 (+ 1847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:49.803581 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:49.804371 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:49.804615 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:49.809871 (+ 5256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:49.809880 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:49.809897 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:49.809955 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:49.814829 (+ 4874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:49.815945 (+ 1116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:49.815953 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:49.815960 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:49.816245 (+ 285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:49.816962 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:49.816969 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:49.816973 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:49.818119 (+ 1146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:49.818590 (+ 471us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:49.819181 (+ 591us) server_negotiation.cc:299] Negotiation successful
0808 08:36:49.819638 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2108,"thread_start_us":1774,"threads_started":1}
I20260808 08:36:49.833084 19261 raft_consensus.cc:348] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fabcf28e375b460e9adb414e440d947c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42899 } }
I20260808 08:36:49.833739 19261 raft_consensus.cc:374] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:36:49.833941 19261 raft_consensus.cc:729] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabcf28e375b460e9adb414e440d947c, State: Initialized, Role: FOLLOWER
I20260808 08:36:49.834777 19261 consensus_queue.cc:260] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fabcf28e375b460e9adb414e440d947c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42899 } }
I20260808 08:36:49.835222 19261 raft_consensus.cc:388] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:36:49.835490 19261 raft_consensus.cc:482] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:36:49.835716 19261 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:36:49.839838 19261 raft_consensus.cc:504] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fabcf28e375b460e9adb414e440d947c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42899 } }
I20260808 08:36:49.840535 19261 leader_election.cc:302] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fabcf28e375b460e9adb414e440d947c; no voters:
I20260808 08:36:49.841531 19261 leader_election.cc:288] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:36:49.841770 19266 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:36:49.843787 19266 raft_consensus.cc:686] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 1 LEADER]: Becoming Leader. State: Replica: fabcf28e375b460e9adb414e440d947c, State: Running, Role: LEADER
I20260808 08:36:49.844759 19266 consensus_queue.cc:237] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fabcf28e375b460e9adb414e440d947c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42899 } }
I20260808 08:36:49.845523 19261 sys_catalog.cc:564] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:36:49.849793 19267 sys_catalog.cc:455] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [sys.catalog]: SysCatalogTable state changed. Reason: New leader fabcf28e375b460e9adb414e440d947c. Latest consensus state: current_term: 1 leader_uuid: "fabcf28e375b460e9adb414e440d947c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fabcf28e375b460e9adb414e440d947c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42899 } } }
I20260808 08:36:49.850194 19268 sys_catalog.cc:455] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fabcf28e375b460e9adb414e440d947c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fabcf28e375b460e9adb414e440d947c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42899 } } }
I20260808 08:36:49.851032 19268 sys_catalog.cc:458] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [sys.catalog]: This master's current role is: LEADER
I20260808 08:36:49.851100 19267 sys_catalog.cc:458] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [sys.catalog]: This master's current role is: LEADER
I20260808 08:36:49.858031 19272 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:36:49.868547 19272 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:36:49.869688 19261 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 08:36:49.898310 19272 catalog_manager.cc:1347] Generated new cluster ID: a2d2ad09a3b0450480efae9ab2c2779c
I20260808 08:36:49.898566 19272 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:36:49.931342 19272 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:36:49.933610 19272 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:36:49.945463 19272 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c: Generated new TSK 0
I20260808 08:36:49.946758 19272 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:36:50.759793 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.164.212:44723/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:42899
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:45561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:36:51 dist-test-slave-chsk krb5kdc[18703](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786178211, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 08:36:51.214028 19311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:36:51.214473 19311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:36:51.214670 19311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:36:51.227129 19311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:36:51.227340 19311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:36:51.227530 19311 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:36:51.244226 19311 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.5.164.212:44723/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:42899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:36:51.246338 19311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:36:51.248368 19311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:36:51.269776 19323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:36:51.269651 19322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:36:51.275631 19311 server_base.cc:1034] running on GCE node
W20260808 08:36:51.275902 19325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:36:51.276793 19311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:36:51.279280 19311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:36:51.280572 19311 hybrid_clock.cc:648] HybridClock initialized: now 1786178211280482 us; error 73 us; skew 500 ppm
I20260808 08:36:51.281050 19311 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:36:51 dist-test-slave-chsk krb5kdc[18703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178211, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:36:51.285956 19311 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:36:51.291724 19311 webserver.cc:460] Webserver started at http://127.5.164.193:46045/ using document root <none> and password file <none>
I20260808 08:36:51.292807 19311 fs_manager.cc:359] Metadata directory not provided
I20260808 08:36:51.292981 19311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:36:51.293414 19311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:36:51 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178211, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
I20260808 08:36:51.320655 19311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "232fb3bd4525479caad2b78fa690953f"
format_stamp: "Formatted at 2026-08-08 08:36:51 on dist-test-slave-chsk"
server_key: "e019c67b3c5374c1175eeaf1c36d72d7"
server_key_iv: "3a3a2e2ec8aa19c86584ecb66c8ee663"
server_key_version: "kuduclusterkey@0"
I20260808 08:36:51.322109 19311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "232fb3bd4525479caad2b78fa690953f"
format_stamp: "Formatted at 2026-08-08 08:36:51 on dist-test-slave-chsk"
server_key: "e019c67b3c5374c1175eeaf1c36d72d7"
server_key_iv: "3a3a2e2ec8aa19c86584ecb66c8ee663"
server_key_version: "kuduclusterkey@0"
I20260808 08:36:51.330448 19311 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.000s sys 0.006s
I20260808 08:36:51.369700 19332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:51.372057 19311 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.005s sys 0.008s
I20260808 08:36:51.372375 19311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "232fb3bd4525479caad2b78fa690953f"
format_stamp: "Formatted at 2026-08-08 08:36:51 on dist-test-slave-chsk"
server_key: "e019c67b3c5374c1175eeaf1c36d72d7"
server_key_iv: "3a3a2e2ec8aa19c86584ecb66c8ee663"
server_key_version: "kuduclusterkey@0"
I20260808 08:36:51.372761 19311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:36:51.415720 19311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:36:51.421608 19311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:36:51.422123 19311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:36:51.423573 19311 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:36:51.425609 19311 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:36:51.425760 19311 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260808 08:36:51.425977 19311 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:36:51.426141 19311 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:51.525465 19311 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:44321
I20260808 08:36:51.525509 19449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:44321 every 8 connection(s)
I20260808 08:36:51.527323 19311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:36:51.531656 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 19311
I20260808 08:36:51.531906 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:36:51.532902 5779 external_mini_cluster.cc:1428] Setting key ca33ec5116795eeb3d74c0dbe94758fd
Aug 08 08:36:51 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178211, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
Aug 08 08:36:51 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178211, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:36:51.590538 19453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:51.532088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:57035 (local address 127.5.164.254:42899)
0808 08:36:51.547978 (+ 15890us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:51.547989 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:51.555645 (+ 7656us) server_negotiation.cc:407] Connection header received
0808 08:36:51.570172 (+ 14527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:51.570180 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:51.570305 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:51.570437 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:51.572812 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:51.573978 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:51.576668 (+ 2690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:51.577344 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:51.577457 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:51.582744 (+ 5287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:51.582752 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:51.582756 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:51.582807 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:51.586486 (+ 3679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:51.587629 (+ 1143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:51.587635 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:51.587638 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:51.587809 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:51.588360 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:51.588365 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:51.588368 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:51.588755 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:51.588885 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:51.589924 (+ 1039us) server_negotiation.cc:299] Negotiation successful
0808 08:36:51.590165 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15698,"thread_start_us":15533,"threads_started":1}
I20260808 08:36:51.593253 19452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:51.531242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:42899 (local address 127.5.164.193:57035)
0808 08:36:51.555027 (+ 23785us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:51.555100 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 08:36:51.563109 (+ 8009us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:36:51.570840 (+ 7731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:36:51.570856 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:36:51.571631 (+ 775us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:36:51.572594 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:51.572620 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:51.574212 (+ 1592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:51.574219 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:51.576453 (+ 2234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:51.576470 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:51.577871 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:51.577879 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:51.578187 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:51.579101 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:36:51.579133 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:36:51.582396 (+ 3263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:36:51.586729 (+ 4333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:36:51.586739 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:36:51.586760 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:36:51.587457 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:36:51.587960 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:36:51.587964 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:36:51.587967 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:36:51.588228 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:36:51.588987 (+ 759us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:36:51.588995 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:36:51.589454 (+ 459us) client_negotiation.cc:769] Sending connection context
0808 08:36:51.591113 (+ 1659us) client_negotiation.cc:240] Negotiation successful
0808 08:36:51.591738 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23425,"thread_start_us":23144,"threads_started":1}
I20260808 08:36:51.595590 19450 heartbeater.cc:347] Connected to a master server at 127.5.164.254:42899
I20260808 08:36:51.595940 19450 heartbeater.cc:464] Registering TS with master...
I20260808 08:36:51.596817 19450 heartbeater.cc:511] Master 127.5.164.254:42899 requested a full tablet report, sending...
I20260808 08:36:51.599472 19225 ts_manager.cc:194] Registered new tserver with Master: 232fb3bd4525479caad2b78fa690953f (127.5.164.193:44321)
I20260808 08:36:51.601500 19225 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:57035
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:36:51.627861 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.164.212:44723/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:42899
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:45561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:36:51 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178211, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
W20260808 08:36:52.147264 19456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:36:52.147786 19456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:36:52.148007 19456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:36:52.159863 19456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:36:52.160120 19456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:36:52.160384 19456 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:36:52.176669 19456 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.5.164.212:44723/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:42899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:36:52.178809 19456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:36:52.180725 19456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:36:52.218127 19465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:36:52.223277 19464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:36:52.226370 19468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:36:52.226905 19456 server_base.cc:1034] running on GCE node
I20260808 08:36:52.227919 19456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:36:52.236057 19456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:36:52.244603 19456 hybrid_clock.cc:648] HybridClock initialized: now 1786178212244456 us; error 151 us; skew 500 ppm
I20260808 08:36:52.245151 19456 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:36:52 dist-test-slave-chsk krb5kdc[18703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178212, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:36:52.249827 19456 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:36:52.270649 19456 webserver.cc:460] Webserver started at http://127.5.164.194:33457/ using document root <none> and password file <none>
I20260808 08:36:52.271863 19456 fs_manager.cc:359] Metadata directory not provided
I20260808 08:36:52.272090 19456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:36:52.272567 19456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:36:52 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178212, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
I20260808 08:36:52.314440 19456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "df2b94c337924490ab6b870a3c4fffff"
format_stamp: "Formatted at 2026-08-08 08:36:52 on dist-test-slave-chsk"
server_key: "bcacfb54e6e33bc1e0e69db84908b939"
server_key_iv: "225875a4991e0a7bcffd783f4da87367"
server_key_version: "kuduclusterkey@0"
I20260808 08:36:52.316776 19456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "df2b94c337924490ab6b870a3c4fffff"
format_stamp: "Formatted at 2026-08-08 08:36:52 on dist-test-slave-chsk"
server_key: "bcacfb54e6e33bc1e0e69db84908b939"
server_key_iv: "225875a4991e0a7bcffd783f4da87367"
server_key_version: "kuduclusterkey@0"
I20260808 08:36:52.349493 19456 fs_manager.cc:691] Time spent creating directory manager: real 0.022s user 0.008s sys 0.012s
I20260808 08:36:52.387939 19482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:52.390058 19456 fs_manager.cc:725] Time spent opening block manager: real 0.022s user 0.003s sys 0.011s
I20260808 08:36:52.390343 19456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "df2b94c337924490ab6b870a3c4fffff"
format_stamp: "Formatted at 2026-08-08 08:36:52 on dist-test-slave-chsk"
server_key: "bcacfb54e6e33bc1e0e69db84908b939"
server_key_iv: "225875a4991e0a7bcffd783f4da87367"
server_key_version: "kuduclusterkey@0"
I20260808 08:36:52.390710 19456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:36:52.450738 19456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:36:52.455227 19456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:36:52.455540 19456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:36:52.456664 19456 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:36:52.458240 19456 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:36:52.458343 19456 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:52.458511 19456 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:36:52.458590 19456 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:52.513399 19608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:35781 every 8 connection(s)
I20260808 08:36:52.513396 19456 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:35781
I20260808 08:36:52.515300 19456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:36:52.523938 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 19456
I20260808 08:36:52.524168 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:36:52.524791 5779 external_mini_cluster.cc:1428] Setting key 9686d17eccc911ebcaccb79263229313
Aug 08 08:36:52 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178212, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:36:52.539955 19611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:52.518130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:52883 (local address 127.5.164.254:42899)
0808 08:36:52.518632 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:52.518638 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:52.519742 (+ 1104us) server_negotiation.cc:407] Connection header received
0808 08:36:52.521567 (+ 1825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:52.521573 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:52.521667 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:52.521797 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:52.523319 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:52.524428 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:52.526850 (+ 2422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:52.527507 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:52.527643 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:52.532113 (+ 4470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:52.532120 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:52.532125 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:52.532165 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:52.536011 (+ 3846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:52.537049 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:52.537055 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:52.537059 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:52.537217 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:52.537789 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:52.537795 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:52.537799 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:52.538170 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:52.538322 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:52.539314 (+ 992us) server_negotiation.cc:299] Negotiation successful
0808 08:36:52.539575 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":252,"threads_started":1}
I20260808 08:36:52.541055 19612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:52.518776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:42899 (local address 127.5.164.194:52883)
0808 08:36:52.519572 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:52.519619 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 08:36:52.521307 (+ 1688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:36:52.521982 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:36:52.522006 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:36:52.522492 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:36:52.523081 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:52.523098 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:52.524644 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:52.524649 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:52.526674 (+ 2025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:52.526689 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:52.527938 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:52.527946 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:52.528230 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:52.529019 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:36:52.529048 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:36:52.531854 (+ 2806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:36:52.536193 (+ 4339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:36:52.536205 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:36:52.536222 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:36:52.536875 (+ 653us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:36:52.537350 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:36:52.537357 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:36:52.537363 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:36:52.537639 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:36:52.538318 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:36:52.538329 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:36:52.538801 (+ 472us) client_negotiation.cc:769] Sending connection context
0808 08:36:52.539113 (+ 312us) client_negotiation.cc:240] Negotiation successful
0808 08:36:52.539731 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":346,"threads_started":1}
I20260808 08:36:52.542591 19609 heartbeater.cc:347] Connected to a master server at 127.5.164.254:42899
I20260808 08:36:52.542933 19609 heartbeater.cc:464] Registering TS with master...
I20260808 08:36:52.543805 19609 heartbeater.cc:511] Master 127.5.164.254:42899 requested a full tablet report, sending...
I20260808 08:36:52.545630 19225 ts_manager.cc:194] Registered new tserver with Master: df2b94c337924490ab6b870a3c4fffff (127.5.164.194:35781)
I20260808 08:36:52.546903 19225 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:52883
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:36:52.595250 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.164.212:44723/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:42899
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:45561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:36:52.605474 19450 heartbeater.cc:503] Master 127.5.164.254:42899 was elected leader, sending a full tablet report...
W20260808 08:36:52.944170 19615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:36:52.944464 19615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:36:52.944643 19615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:36:52.952217 19615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:36:52.952330 19615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:36:52.952514 19615 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:36:52.962813 19615 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.5.164.212:44723/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:42899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:36:52.964207 19615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:36:52.965567 19615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:36:52.979239 19621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:36:52.979264 19620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:36:52.979298 19623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:36:52.980396 19615 server_base.cc:1034] running on GCE node
I20260808 08:36:52.981032 19615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:36:52.982086 19615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:36:52.983251 19615 hybrid_clock.cc:648] HybridClock initialized: now 1786178212983208 us; error 72 us; skew 500 ppm
I20260808 08:36:52.983589 19615 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:36:52 dist-test-slave-chsk krb5kdc[18703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178212, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:36:52.987044 19615 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:36:52.988667 19615 webserver.cc:460] Webserver started at http://127.5.164.195:32831/ using document root <none> and password file <none>
I20260808 08:36:52.989377 19615 fs_manager.cc:359] Metadata directory not provided
I20260808 08:36:52.989509 19615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:36:52.989847 19615 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 08:36:52 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178212, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
I20260808 08:36:53.006352 19615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "ab87c6b342004cd99b25213de98bd438"
format_stamp: "Formatted at 2026-08-08 08:36:53 on dist-test-slave-chsk"
server_key: "fbe1873da1a17cadd492d3b47523b073"
server_key_iv: "0e526f03f47a979ffb94edabd35a0b30"
server_key_version: "kuduclusterkey@0"
I20260808 08:36:53.007359 19615 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "ab87c6b342004cd99b25213de98bd438"
format_stamp: "Formatted at 2026-08-08 08:36:53 on dist-test-slave-chsk"
server_key: "fbe1873da1a17cadd492d3b47523b073"
server_key_iv: "0e526f03f47a979ffb94edabd35a0b30"
server_key_version: "kuduclusterkey@0"
I20260808 08:36:53.013147 19615 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:36:53.028508 19630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:53.030243 19615 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260808 08:36:53.030421 19615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "ab87c6b342004cd99b25213de98bd438"
format_stamp: "Formatted at 2026-08-08 08:36:53 on dist-test-slave-chsk"
server_key: "fbe1873da1a17cadd492d3b47523b073"
server_key_iv: "0e526f03f47a979ffb94edabd35a0b30"
server_key_version: "kuduclusterkey@0"
I20260808 08:36:53.030683 19615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:36:53.054153 19615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:36:53.058728 19615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:36:53.059067 19615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:36:53.060277 19615 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:36:53.061770 19615 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:36:53.061856 19615 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:53.061944 19615 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:36:53.062009 19615 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:53.097478 19615 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:35751
I20260808 08:36:53.097582 19752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:35751 every 8 connection(s)
I20260808 08:36:53.098858 19615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:36:53.107594 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 19615
I20260808 08:36:53.107781 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:36:53.108270 5779 external_mini_cluster.cc:1428] Setting key d1cbad178b8b5687feb8f99e5f099a59
Aug 08 08:36:53 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178212, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:36:53.120221 19755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:53.101534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:60611 (local address 127.5.164.254:42899)
0808 08:36:53.102028 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:53.102033 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:53.103003 (+ 970us) server_negotiation.cc:407] Connection header received
0808 08:36:53.104871 (+ 1868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:53.104876 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:53.104971 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:53.105105 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:53.106519 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:53.107421 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:53.109497 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:53.110121 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:53.110274 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:53.114160 (+ 3886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:53.114166 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:53.114169 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:53.114223 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:53.117206 (+ 2983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:53.117988 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:53.117992 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:53.117994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:53.118133 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:53.118558 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:53.118561 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:53.118563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:53.118841 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:53.118954 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:53.119751 (+ 797us) server_negotiation.cc:299] Negotiation successful
0808 08:36:53.119938 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":232,"threads_started":1}
I20260808 08:36:53.121251 19756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:53.102125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:42899 (local address 127.5.164.195:60611)
0808 08:36:53.102837 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:53.102876 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:36:53.104602 (+ 1726us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:36:53.105336 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:36:53.105344 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:36:53.105780 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:36:53.106330 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:53.106348 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:53.107612 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:53.107616 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:53.109286 (+ 1670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:53.109316 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:53.110381 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:53.110388 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:53.110695 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:53.111500 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:36:53.111540 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:36:53.113894 (+ 2354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:36:53.117387 (+ 3493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:36:53.117394 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:36:53.117407 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:36:53.117868 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:36:53.118238 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:36:53.118241 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:36:53.118243 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:36:53.118445 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:36:53.118957 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:36:53.118963 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:36:53.119385 (+ 422us) client_negotiation.cc:769] Sending connection context
0808 08:36:53.119644 (+ 259us) client_negotiation.cc:240] Negotiation successful
0808 08:36:53.120023 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":287,"threads_started":1}
I20260808 08:36:53.123057 19753 heartbeater.cc:347] Connected to a master server at 127.5.164.254:42899
I20260808 08:36:53.123440 19753 heartbeater.cc:464] Registering TS with master...
I20260808 08:36:53.124365 19753 heartbeater.cc:511] Master 127.5.164.254:42899 requested a full tablet report, sending...
I20260808 08:36:53.125845 19225 ts_manager.cc:194] Registered new tserver with Master: ab87c6b342004cd99b25213de98bd438 (127.5.164.195:35751)
I20260808 08:36:53.126761 19225 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:60611
I20260808 08:36:53.136689 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:36:53.138527 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 19311
Aug 08 08:36:53 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:36:53.156255 19758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:53.139617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50968 (local address 127.5.164.193:44321)
0808 08:36:53.140559 (+ 942us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:53.140566 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:53.140598 (+ 32us) server_negotiation.cc:407] Connection header received
0808 08:36:53.140660 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:53.140667 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:53.140862 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:53.140990 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:53.142533 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:53.143673 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:53.145159 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:53.145681 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:53.145778 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:53.150379 (+ 4601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:53.150390 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:53.150405 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:53.150442 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:53.153578 (+ 3136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:53.154255 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:53.154263 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:53.154265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:53.154416 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:53.154760 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:53.154763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:53.154765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:53.155116 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:53.155424 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:53.155744 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 08:36:53.155943 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":801,"thread_start_us":649,"threads_started":1}
I20260808 08:36:53.157536 19445 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:36:53.243901 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 19311
I20260808 08:36:53.264380 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 19456
Aug 08 08:36:53 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:36:53.281387 19760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:53.265344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45232 (local address 127.5.164.194:35781)
0808 08:36:53.265959 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:53.265966 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:53.265992 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:36:53.266054 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:53.266060 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:53.266267 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:53.266398 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:53.267828 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:53.268865 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:53.270147 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:53.270708 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:53.270812 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:53.275277 (+ 4465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:53.275290 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:53.275303 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:53.275345 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:53.278258 (+ 2913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:53.278967 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:53.278974 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:53.278976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:53.279131 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:53.279631 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:53.279637 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:53.279640 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:53.280075 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:53.280411 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:53.280718 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 08:36:53.280998 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":336,"threads_started":1}
I20260808 08:36:53.282748 19602 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:36:53.380357 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 19456
I20260808 08:36:53.404574 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 19615
Aug 08 08:36:53 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:36:53.421758 19762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:53.405511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34724 (local address 127.5.164.195:35751)
0808 08:36:53.406120 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:53.406127 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:53.406157 (+ 30us) server_negotiation.cc:407] Connection header received
0808 08:36:53.406217 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:53.406224 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:53.406438 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:53.406626 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:53.408113 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:53.409125 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:53.410584 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:53.411129 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:53.411332 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:53.415948 (+ 4616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:53.415961 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:53.415975 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:53.416013 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:53.418764 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:53.419586 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:53.419592 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:53.419594 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:53.419717 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:53.420104 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:53.420111 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:53.420118 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:53.420448 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:53.420795 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:53.421112 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 08:36:53.421381 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":289,"threads_started":1}
I20260808 08:36:53.423126 19747 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:36:53.507833 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 19615
I20260808 08:36:53.525377 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 19188
I20260808 08:36:53.526744 19256 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:36:53.641098 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 19188
I20260808 08:36:53.669881 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:42899
--webserver_interface=127.5.164.254
--webserver_port=46169
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:45561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:42899
--ranger_config_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.164.212:44723/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.5.164.212:44723/kms with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:36:54.012100 19765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:36:54.012411 19765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:36:54.012573 19765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:36:54.020139 19765 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:36:54.020263 19765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:36:54.020399 19765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:36:54.020504 19765 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:36:54.020601 19765 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:36:54.031378 19765 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.5.164.212:44723/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:42899
--ranger_config_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:42899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=46169
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:36:54.032734 19765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:36:54.034148 19765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:36:54.046491 19772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:36:54.046566 19771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:36:54.046604 19774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:36:54.047312 19765 server_base.cc:1034] running on GCE node
I20260808 08:36:54.048159 19765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:36:54.049647 19765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:36:54.050904 19765 hybrid_clock.cc:648] HybridClock initialized: now 1786178214050849 us; error 65 us; skew 500 ppm
I20260808 08:36:54.051395 19765 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:36:54 dist-test-slave-chsk krb5kdc[18703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178214, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:36:54.054634 19765 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:36:54.056205 19765 webserver.cc:460] Webserver started at http://127.5.164.254:46169/ using document root <none> and password file <none>
I20260808 08:36:54.056907 19765 fs_manager.cc:359] Metadata directory not provided
I20260808 08:36:54.057179 19765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 08:36:54 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178214, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
I20260808 08:36:54.144023 19765 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.003s
I20260808 08:36:54.147313 19783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:54.148788 19765 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:36:54.149020 19765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "fabcf28e375b460e9adb414e440d947c"
format_stamp: "Formatted at 2026-08-08 08:36:49 on dist-test-slave-chsk"
server_key: "4d0b8a6177510cbbe077095e8c7f6410"
server_key_iv: "9a2642c71e1faf58eed04876c132b3ff"
server_key_version: "kuduclusterkey@0"
I20260808 08:36:54.150071 19765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:36:54.170851 19765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:36:54.174927 19765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:36:54.175263 19765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:36:54.194355 19765 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:42899
I20260808 08:36:54.194384 19837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:42899 every 8 connection(s)
I20260808 08:36:54.195982 19765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:36:54.200181 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 19765
I20260808 08:36:54.201105 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.164.212:44723/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:44321
--local_ip_for_outbound_sockets=127.5.164.193
--tserver_master_addrs=127.5.164.254:42899
--webserver_port=46045
--webserver_interface=127.5.164.193
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:45561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.5.164.212:44723/kms with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:36:54.202801 19838 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:36:54.206094 19838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c: Bootstrap starting.
I20260808 08:36:54.225592 19838 log.cc:824] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:36:54.234316 19838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:36:54.234889 19838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c: Bootstrap complete.
I20260808 08:36:54.244316 19838 raft_consensus.cc:348] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fabcf28e375b460e9adb414e440d947c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42899 } }
I20260808 08:36:54.245239 19838 raft_consensus.cc:729] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fabcf28e375b460e9adb414e440d947c, State: Initialized, Role: FOLLOWER
I20260808 08:36:54.245862 19838 consensus_queue.cc:260] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fabcf28e375b460e9adb414e440d947c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42899 } }
I20260808 08:36:54.246109 19838 raft_consensus.cc:388] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:36:54.246248 19838 raft_consensus.cc:482] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:36:54.246428 19838 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:36:54.250270 19838 raft_consensus.cc:504] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fabcf28e375b460e9adb414e440d947c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42899 } }
I20260808 08:36:54.250759 19838 leader_election.cc:302] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fabcf28e375b460e9adb414e440d947c; no voters:
I20260808 08:36:54.251483 19838 leader_election.cc:288] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 08:36:54.251639 19842 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:36:54.253022 19842 raft_consensus.cc:686] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [term 2 LEADER]: Becoming Leader. State: Replica: fabcf28e375b460e9adb414e440d947c, State: Running, Role: LEADER
I20260808 08:36:54.253639 19842 consensus_queue.cc:237] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fabcf28e375b460e9adb414e440d947c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42899 } }
I20260808 08:36:54.253981 19838 sys_catalog.cc:564] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:36:54.262809 19844 sys_catalog.cc:455] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [sys.catalog]: SysCatalogTable state changed. Reason: New leader fabcf28e375b460e9adb414e440d947c. Latest consensus state: current_term: 2 leader_uuid: "fabcf28e375b460e9adb414e440d947c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fabcf28e375b460e9adb414e440d947c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42899 } } }
I20260808 08:36:54.263605 19844 sys_catalog.cc:458] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [sys.catalog]: This master's current role is: LEADER
I20260808 08:36:54.263226 19843 sys_catalog.cc:455] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fabcf28e375b460e9adb414e440d947c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fabcf28e375b460e9adb414e440d947c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42899 } } }
I20260808 08:36:54.264561 19843 sys_catalog.cc:458] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c [sys.catalog]: This master's current role is: LEADER
I20260808 08:36:54.269492 19853 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:36:54.275300 19853 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:36:54.276170 19838 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 08:36:54.276871 19853 catalog_manager.cc:1259] Loaded cluster ID: a2d2ad09a3b0450480efae9ab2c2779c
I20260808 08:36:54.277035 19853 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:36:54.281075 19853 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:36:54.282853 19853 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c: Loaded TSK: 0
I20260808 08:36:54.284432 19853 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:36:54.660636 19840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:36:54.661177 19840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:36:54.661427 19840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:36:54.673452 19840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:36:54.673707 19840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:36:54.673969 19840 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:36:54.690264 19840 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.5.164.212:44723/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:44321
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=46045
--tserver_master_addrs=127.5.164.254:42899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:36:54.692468 19840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:36:54.694393 19840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:36:54.722116 19876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:36:54.722764 19877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:36:54.730481 19879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:36:54.731092 19840 server_base.cc:1034] running on GCE node
I20260808 08:36:54.732084 19840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:36:54.734615 19840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:36:54.735914 19840 hybrid_clock.cc:648] HybridClock initialized: now 1786178214735857 us; error 50 us; skew 500 ppm
I20260808 08:36:54.737866 19840 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:36:54 dist-test-slave-chsk krb5kdc[18703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178214, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:36:54.745227 19840 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:36:54.750696 19840 webserver.cc:460] Webserver started at http://127.5.164.193:46045/ using document root <none> and password file <none>
I20260808 08:36:54.751843 19840 fs_manager.cc:359] Metadata directory not provided
I20260808 08:36:54.752002 19840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 08:36:54 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178214, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
I20260808 08:36:54.777608 19840 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:36:54.781188 19887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:54.783172 19840 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 08:36:54.783434 19840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "232fb3bd4525479caad2b78fa690953f"
format_stamp: "Formatted at 2026-08-08 08:36:51 on dist-test-slave-chsk"
server_key: "e019c67b3c5374c1175eeaf1c36d72d7"
server_key_iv: "3a3a2e2ec8aa19c86584ecb66c8ee663"
server_key_version: "kuduclusterkey@0"
I20260808 08:36:54.784986 19840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:36:54.812716 19840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:36:54.817708 19840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:36:54.818027 19840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:36:54.819269 19840 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:36:54.821202 19840 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:36:54.821324 19840 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:54.821458 19840 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:36:54.821542 19840 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:54.896584 19840 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:44321
I20260808 08:36:54.896628 20010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:44321 every 8 connection(s)
I20260808 08:36:54.898200 19840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:36:54.903878 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 19840
I20260808 08:36:54.904973 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.164.212:44723/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:35781
--local_ip_for_outbound_sockets=127.5.164.194
--tserver_master_addrs=127.5.164.254:42899
--webserver_port=33457
--webserver_interface=127.5.164.194
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:45561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.5.164.212:44723/kms with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:36:54 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178214, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:36:54.950448 20014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:54.902050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:42899 (local address 127.5.164.193:45421)
0808 08:36:54.919065 (+ 17015us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:54.919132 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 08:36:54.922440 (+ 3308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:36:54.926804 (+ 4364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:36:54.926818 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:36:54.927554 (+ 736us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:36:54.928423 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:54.928455 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:54.931078 (+ 2623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:54.931087 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:54.933442 (+ 2355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:54.933461 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:54.935589 (+ 2128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:54.935599 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:54.935964 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:54.936833 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:36:54.937109 (+ 276us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:36:54.940285 (+ 3176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:36:54.944835 (+ 4550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:36:54.944847 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:36:54.944865 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:36:54.945594 (+ 729us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:36:54.946249 (+ 655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:36:54.946257 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:36:54.946264 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:36:54.946571 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:36:54.947714 (+ 1143us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:36:54.947723 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:36:54.948205 (+ 482us) client_negotiation.cc:769] Sending connection context
0808 08:36:54.948509 (+ 304us) client_negotiation.cc:240] Negotiation successful
0808 08:36:54.949079 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16672,"thread_start_us":18100,"threads_started":1}
I20260808 08:36:54.952162 20013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:54.901933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:45421 (local address 127.5.164.254:42899)
0808 08:36:54.918117 (+ 16184us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:54.918144 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:54.920360 (+ 2216us) server_negotiation.cc:407] Connection header received
0808 08:36:54.923363 (+ 3003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:54.923388 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:54.925586 (+ 2198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:54.926034 (+ 448us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:54.928697 (+ 2663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:54.930841 (+ 2144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:54.933640 (+ 2799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:54.934910 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:54.935089 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:54.940644 (+ 5555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:54.940656 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:54.940678 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:54.940733 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:54.944635 (+ 3902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:54.945804 (+ 1169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:54.945813 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:54.945820 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:54.946086 (+ 266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:54.946740 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:54.946745 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:54.946748 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:54.947514 (+ 766us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:54.947720 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:54.950334 (+ 2614us) server_negotiation.cc:299] Negotiation successful
0808 08:36:54.950864 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15823,"thread_start_us":16078,"threads_started":1}
I20260808 08:36:54.956146 20011 heartbeater.cc:347] Connected to a master server at 127.5.164.254:42899
I20260808 08:36:54.956502 20011 heartbeater.cc:464] Registering TS with master...
I20260808 08:36:54.957463 20011 heartbeater.cc:511] Master 127.5.164.254:42899 requested a full tablet report, sending...
W20260808 08:36:54.961185 20011 heartbeater.cc:644] Failed to heartbeat to 127.5.164.254:42899 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 08:36:54.961432 20011 heartbeater.cc:464] Registering TS with master...
I20260808 08:36:54.961728 20011 heartbeater.cc:511] Master 127.5.164.254:42899 requested a full tablet report, sending...
I20260808 08:36:54.963186 20011 heartbeater.cc:464] Registering TS with master...
I20260808 08:36:54.963547 20011 heartbeater.cc:511] Master 127.5.164.254:42899 requested a full tablet report, sending...
W20260808 08:36:54.964824 20011 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:36:55.337046 20015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:36:55.337342 20015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:36:55.337509 20015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:36:55.345088 20015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:36:55.345271 20015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:36:55.345465 20015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:36:55.359102 20015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.5.164.212:44723/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:35781
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=33457
--tserver_master_addrs=127.5.164.254:42899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:36:55.360989 20015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:36:55.362428 20015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:36:55.380457 20031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:36:55.380420 20030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:36:55.387738 20033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:36:55.388578 20015 server_base.cc:1034] running on GCE node
I20260808 08:36:55.389282 20015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:36:55.390443 20015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:36:55.391718 20015 hybrid_clock.cc:648] HybridClock initialized: now 1786178215391663 us; error 60 us; skew 500 ppm
I20260808 08:36:55.392055 20015 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:36:55 dist-test-slave-chsk krb5kdc[18703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178215, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:36:55.395424 20015 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:36:55.400204 20015 webserver.cc:460] Webserver started at http://127.5.164.194:33457/ using document root <none> and password file <none>
I20260808 08:36:55.400938 20015 fs_manager.cc:359] Metadata directory not provided
I20260808 08:36:55.401110 20015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 08:36:55 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178215, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
I20260808 08:36:55.429222 20015 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:36:55.439296 20043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.005s user 0.000s sys 0.000s
I20260808 08:36:55.441453 20015 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.000s sys 0.004s
I20260808 08:36:55.441726 20015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "df2b94c337924490ab6b870a3c4fffff"
format_stamp: "Formatted at 2026-08-08 08:36:52 on dist-test-slave-chsk"
server_key: "bcacfb54e6e33bc1e0e69db84908b939"
server_key_iv: "225875a4991e0a7bcffd783f4da87367"
server_key_version: "kuduclusterkey@0"
I20260808 08:36:55.443364 20015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:36:55.474175 20015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:36:55.480078 20015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:36:55.480487 20015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:36:55.491380 20015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:36:55.496088 20015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:36:55.496233 20015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:55.496402 20015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:36:55.496497 20015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:55.554669 20015 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:35781
I20260808 08:36:55.554769 20165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:35781 every 8 connection(s)
Aug 08 08:36:55 dist-test-slave-chsk krb5kdc[18703](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786178215, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:36:55.556562 20015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:36:55.562013 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 20015
I20260808 08:36:55.562872 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.5.164.212:44723/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:35751
--local_ip_for_outbound_sockets=127.5.164.195
--tserver_master_addrs=127.5.164.254:42899
--webserver_port=32831
--webserver_interface=127.5.164.195
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:45561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.5.164.212:44723/kms with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:36:55 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178215, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:36:55.587582 20168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:55.560596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:42899 (local address 127.5.164.194:34997)
0808 08:36:55.562999 (+ 2403us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:55.563057 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 08:36:55.566515 (+ 3458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:36:55.567520 (+ 1005us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:36:55.567532 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:36:55.568131 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:36:55.568926 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:55.568952 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:55.570570 (+ 1618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:55.570575 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:55.572583 (+ 2008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:55.572610 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:55.573929 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:55.573936 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:55.574237 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:55.575106 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:36:55.575166 (+ 60us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:36:55.578109 (+ 2943us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:36:55.582430 (+ 4321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:36:55.582441 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:36:55.582461 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:36:55.583119 (+ 658us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:36:55.583630 (+ 511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:36:55.583634 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:36:55.583638 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:36:55.583915 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:36:55.584682 (+ 767us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:36:55.584690 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:36:55.585130 (+ 440us) client_negotiation.cc:769] Sending connection context
0808 08:36:55.585437 (+ 307us) client_negotiation.cc:240] Negotiation successful
0808 08:36:55.586071 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2097,"thread_start_us":1858,"threads_started":1}
I20260808 08:36:55.592298 20169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:55.561288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:34997 (local address 127.5.164.254:42899)
0808 08:36:55.563985 (+ 2697us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:55.563992 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:55.564017 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:36:55.566818 (+ 2801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:55.566824 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:55.566933 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:55.567039 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:55.569165 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:55.570375 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:55.572788 (+ 2413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:55.573475 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:55.573606 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:55.578384 (+ 4778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:55.578391 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:55.578396 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:55.578454 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:55.582235 (+ 3781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:55.583310 (+ 1075us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:55.583319 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:55.583325 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:55.583481 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:55.584057 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:55.584062 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:55.584066 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:55.584435 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:55.584593 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:55.591421 (+ 6828us) server_negotiation.cc:299] Negotiation successful
0808 08:36:55.591765 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2578,"thread_start_us":2471,"threads_started":1}
I20260808 08:36:55.594576 20166 heartbeater.cc:347] Connected to a master server at 127.5.164.254:42899
I20260808 08:36:55.594952 20166 heartbeater.cc:464] Registering TS with master...
I20260808 08:36:55.595958 20166 heartbeater.cc:511] Master 127.5.164.254:42899 requested a full tablet report, sending...
I20260808 08:36:55.598234 19803 ts_manager.cc:194] Registered new tserver with Master: df2b94c337924490ab6b870a3c4fffff (127.5.164.194:35781)
I20260808 08:36:55.600543 19803 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:34997
I20260808 08:36:55.964985 20011 heartbeater.cc:464] Registering TS with master...
I20260808 08:36:55.965454 20011 heartbeater.cc:511] Master 127.5.164.254:42899 requested a full tablet report, sending...
I20260808 08:36:55.966964 19803 ts_manager.cc:194] Registered new tserver with Master: 232fb3bd4525479caad2b78fa690953f (127.5.164.193:44321)
I20260808 08:36:55.968267 19803 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:45421
Aug 08 08:36:55 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178215, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
W20260808 08:36:56.021551 20170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:36:56.022122 20170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:36:56.022368 20170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:36:56.033967 20170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:36:56.034247 20170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:36:56.034503 20170 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:36:56.050879 20170 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.5.164.212:44723/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:35751
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=32831
--tserver_master_addrs=127.5.164.254:42899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:36:56.053056 20170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:36:56.055325 20170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:36:56.089934 20176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:36:56.088949 20177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:36:56.095858 20179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:36:56.100449 20170 server_base.cc:1034] running on GCE node
I20260808 08:36:56.101488 20170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:36:56.103447 20170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:36:56.104773 20170 hybrid_clock.cc:648] HybridClock initialized: now 1786178216104698 us; error 70 us; skew 500 ppm
I20260808 08:36:56.105211 20170 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:36:56 dist-test-slave-chsk krb5kdc[18703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178216, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:36:56.109793 20170 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:36:56.111989 20170 webserver.cc:460] Webserver started at http://127.5.164.195:32831/ using document root <none> and password file <none>
I20260808 08:36:56.112994 20170 fs_manager.cc:359] Metadata directory not provided
I20260808 08:36:56.113164 20170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 08:36:56 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178216, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
I20260808 08:36:56.149036 20170 fs_manager.cc:709] Time spent opening directory manager: real 0.013s user 0.009s sys 0.001s
I20260808 08:36:56.155849 20188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:56.157612 20170 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.006s sys 0.000s
I20260808 08:36:56.157832 20170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "ab87c6b342004cd99b25213de98bd438"
format_stamp: "Formatted at 2026-08-08 08:36:53 on dist-test-slave-chsk"
server_key: "fbe1873da1a17cadd492d3b47523b073"
server_key_iv: "0e526f03f47a979ffb94edabd35a0b30"
server_key_version: "kuduclusterkey@0"
I20260808 08:36:56.159080 20170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:36:56.183468 20170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:36:56.189034 20170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:36:56.189365 20170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:36:56.190726 20170 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:36:56.192628 20170 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:36:56.192770 20170 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:56.192888 20170 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:36:56.192972 20170 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:36:56.251348 20170 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:35751
I20260808 08:36:56.251420 20309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:35751 every 8 connection(s)
I20260808 08:36:56.253443 20170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:36:56.254547 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 20170
Aug 08 08:36:56 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178216, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:36:56.294252 20311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.255675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42752 (local address 127.5.164.254:42899)
0808 08:36:56.275609 (+ 19934us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:56.275615 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:56.275637 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:36:56.275700 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:56.275705 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:56.275803 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:56.277961 (+ 2158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:56.278120 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.279176 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.281039 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.281771 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.285277 (+ 3506us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.285528 (+ 251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:56.285533 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:56.285537 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:56.285564 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:56.289306 (+ 3742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:56.290296 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:56.290301 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:56.290304 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:56.290464 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:56.291251 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:56.291256 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:56.291260 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:56.291656 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:56.293441 (+ 1785us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:56.293609 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 08:36:56.293852 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19605,"thread_start_us":19484,"threads_started":1}
I20260808 08:36:56.298401 20314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.266004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:40589 (local address 127.5.164.254:42899)
0808 08:36:56.277410 (+ 11406us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:56.277416 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:56.277436 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:36:56.277500 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:56.277505 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:56.277588 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:56.280649 (+ 3061us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:56.280866 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.282139 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.284631 (+ 2492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.285303 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.286298 (+ 995us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.289905 (+ 3607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:56.289913 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:56.289918 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:56.289959 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:56.293578 (+ 3619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:56.294606 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:56.294611 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:56.294615 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:56.295102 (+ 487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:56.295756 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:56.295761 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:56.295764 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:56.296108 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:56.297622 (+ 1514us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:56.297767 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 08:36:56.298011 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11272,"thread_start_us":11703,"threads_started":1}
I20260808 08:36:56.299206 20315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.266793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:42899 (local address 127.5.164.195:40589)
0808 08:36:56.271735 (+ 4942us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:56.271796 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 08:36:56.274076 (+ 2280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:36:56.278141 (+ 4065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:36:56.278159 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:36:56.278794 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:36:56.279668 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:56.279712 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.282321 (+ 2609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.282327 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:56.284402 (+ 2075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:56.284429 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.285577 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.285586 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:56.285900 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.286648 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:36:56.286677 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:36:56.289576 (+ 2899us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:36:56.293767 (+ 4191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:36:56.293777 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:36:56.293797 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:36:56.294441 (+ 644us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:36:56.295275 (+ 834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:36:56.295280 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:36:56.295283 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:36:56.295575 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:36:56.296271 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:36:56.296279 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:36:56.296747 (+ 468us) client_negotiation.cc:769] Sending connection context
0808 08:36:56.297036 (+ 289us) client_negotiation.cc:240] Negotiation successful
0808 08:36:56.297602 (+ 566us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4631,"thread_start_us":4409,"threads_started":1}
I20260808 08:36:56.300951 20310 heartbeater.cc:347] Connected to a master server at 127.5.164.254:42899
I20260808 08:36:56.301299 20310 heartbeater.cc:464] Registering TS with master...
I20260808 08:36:56.302292 20310 heartbeater.cc:511] Master 127.5.164.254:42899 requested a full tablet report, sending...
I20260808 08:36:56.304111 19803 ts_manager.cc:194] Registered new tserver with Master: ab87c6b342004cd99b25213de98bd438 (127.5.164.195:35751)
I20260808 08:36:56.305163 19803 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:40589
I20260808 08:36:56.310031 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:36:56.331875 20314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.314009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42764 (local address 127.5.164.254:42899)
0808 08:36:56.314430 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:56.314436 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:56.314457 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:36:56.314542 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:56.314547 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:56.314620 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:56.314729 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:56.316661 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.317753 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.319825 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.320447 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.320625 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.324344 (+ 3719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:56.324350 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:56.324354 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:56.324396 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:56.327795 (+ 3399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:56.328648 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:56.328654 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:56.328658 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:56.328822 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:56.329301 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:56.329307 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:56.329310 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:56.329684 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:56.329939 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:56.331253 (+ 1314us) server_negotiation.cc:299] Negotiation successful
0808 08:36:56.331513 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294}
I20260808 08:36:56.337922 19803 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42764:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:36:56.349063 19803 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 08 08:36:56 dist-test-slave-chsk krb5kdc[18703](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178215, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for HTTP/127.5.164.212@KRBTEST.COM
I20260808 08:36:56.409744 20327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.372829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:44321 (local address 127.0.0.1:50982)
0808 08:36:56.398525 (+ 25696us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:56.398596 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0808 08:36:56.398817 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:36:56.400434 (+ 1617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:36:56.400442 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:36:56.400476 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:36:56.400884 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:56.400896 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.403397 (+ 2501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.403402 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:56.405844 (+ 2442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:56.405862 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.408327 (+ 2465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.408336 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:56.408651 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.408726 (+ 75us) client_negotiation.cc:769] Sending connection context
0808 08:36:56.408860 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 08:36:56.409113 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25405,"mutex_wait_us":1,"thread_start_us":31883,"threads_started":1}
I20260808 08:36:56.411883 20330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.376305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50982 (local address 127.5.164.193:44321)
0808 08:36:56.399527 (+ 23222us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:56.399535 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:56.399567 (+ 32us) server_negotiation.cc:407] Connection header received
0808 08:36:56.399680 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:56.399688 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:56.399951 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:56.400136 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:36:56.401673 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.403232 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.406090 (+ 2858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.407998 (+ 1908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.410713 (+ 2715us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.411048 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:56.411135 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 08:36:56.411384 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23020,"thread_start_us":22886,"threads_started":1}
I20260808 08:36:56.417691 19943 tablet_service.cc:1467] Processing CreateTablet for tablet 726a5284221d49738a44ec79811f193d (DEFAULT_TABLE table=test-table [id=909c22c9a10f43c59acfe816da2a1941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:36:56.419400 19943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 726a5284221d49738a44ec79811f193d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:36:56.420517 20327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.405848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:35751 (local address 127.0.0.1:34734)
0808 08:36:56.410346 (+ 4498us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:56.410370 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:36:56.410492 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:36:56.413755 (+ 3263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:36:56.413760 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:36:56.413786 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:36:56.413947 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:56.413957 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.416107 (+ 2150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.416113 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:56.417910 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:56.417925 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.419805 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.419811 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:56.419986 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.420023 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:36:56.420093 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 08:36:56.420233 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4370,"thread_start_us":6556,"threads_started":1}
I20260808 08:36:56.421737 20332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.406243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34734 (local address 127.5.164.195:35751)
0808 08:36:56.413072 (+ 6829us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:56.413080 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:56.413184 (+ 104us) server_negotiation.cc:407] Connection header received
0808 08:36:56.413280 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:56.413287 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:56.413526 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:56.414121 (+ 595us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:36:56.414423 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.415950 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.418115 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.419615 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.420951 (+ 1336us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.421167 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:56.421234 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 08:36:56.421391 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6627,"thread_start_us":8905,"threads_started":1}
I20260808 08:36:56.426715 20241 tablet_service.cc:1467] Processing CreateTablet for tablet 726a5284221d49738a44ec79811f193d (DEFAULT_TABLE table=test-table [id=909c22c9a10f43c59acfe816da2a1941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:36:56.428120 20241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 726a5284221d49738a44ec79811f193d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:36:56.428413 20328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.374010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45244 (local address 127.5.164.194:35781)
0808 08:36:56.397728 (+ 23718us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:56.397739 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:56.404585 (+ 6846us) server_negotiation.cc:407] Connection header received
0808 08:36:56.404796 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:56.404804 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:56.405038 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:56.405254 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:36:56.406231 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.408136 (+ 1905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.425373 (+ 17237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.426914 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.427039 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.427269 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:56.427912 (+ 643us) server_negotiation.cc:299] Negotiation successful
0808 08:36:56.428097 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23504,"thread_start_us":23747,"threads_started":1}
I20260808 08:36:56.429193 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.373467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:35781 (local address 127.0.0.1:45244)
0808 08:36:56.404421 (+ 30954us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:56.404436 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:36:56.404606 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:36:56.405484 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:36:56.405488 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:36:56.405510 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:36:56.406001 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:56.406019 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.411019 (+ 5000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.411028 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:56.414500 (+ 3472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:56.414514 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.427479 (+ 12965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.427485 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:56.427654 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.427704 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 08:36:56.428708 (+ 1004us) client_negotiation.cc:240] Negotiation successful
0808 08:36:56.428866 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30853,"thread_start_us":27558,"threads_started":1}
I20260808 08:36:56.432766 20097 tablet_service.cc:1467] Processing CreateTablet for tablet 726a5284221d49738a44ec79811f193d (DEFAULT_TABLE table=test-table [id=909c22c9a10f43c59acfe816da2a1941]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:36:56.434098 20097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 726a5284221d49738a44ec79811f193d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:36:56.437167 20333 tablet_bootstrap.cc:492] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f: Bootstrap starting.
I20260808 08:36:56.442377 20333 tablet_bootstrap.cc:654] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f: Neither blocks nor log segments found. Creating new log.
I20260808 08:36:56.447079 20333 log.cc:824] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:36:56.448853 20334 tablet_bootstrap.cc:492] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438: Bootstrap starting.
I20260808 08:36:56.454762 20333 tablet_bootstrap.cc:492] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f: No bootstrap required, opened a new log
I20260808 08:36:56.455302 20333 ts_tablet_manager.cc:1397] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.003s
I20260808 08:36:56.460876 20334 tablet_bootstrap.cc:654] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438: Neither blocks nor log segments found. Creating new log.
I20260808 08:36:56.464560 20334 log.cc:824] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438: Log is configured to *not* fsync() on all Append() calls
I20260808 08:36:56.470165 20333 raft_consensus.cc:348] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "232fb3bd4525479caad2b78fa690953f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44321 } } peers { permanent_uuid: "ab87c6b342004cd99b25213de98bd438" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35751 } } peers { permanent_uuid: "df2b94c337924490ab6b870a3c4fffff" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35781 } }
I20260808 08:36:56.470687 20333 raft_consensus.cc:374] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:36:56.472826 20333 raft_consensus.cc:729] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 232fb3bd4525479caad2b78fa690953f, State: Initialized, Role: FOLLOWER
I20260808 08:36:56.474128 20333 consensus_queue.cc:260] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "232fb3bd4525479caad2b78fa690953f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44321 } } peers { permanent_uuid: "ab87c6b342004cd99b25213de98bd438" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35751 } } peers { permanent_uuid: "df2b94c337924490ab6b870a3c4fffff" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35781 } }
I20260808 08:36:56.478864 20336 tablet_bootstrap.cc:492] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff: Bootstrap starting.
I20260808 08:36:56.480769 20011 heartbeater.cc:503] Master 127.5.164.254:42899 was elected leader, sending a full tablet report...
I20260808 08:36:56.481801 20333 ts_tablet_manager.cc:1428] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f: Time spent starting tablet: real 0.026s user 0.011s sys 0.001s
I20260808 08:36:56.483856 20334 tablet_bootstrap.cc:492] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438: No bootstrap required, opened a new log
I20260808 08:36:56.484210 20334 ts_tablet_manager.cc:1397] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438: Time spent bootstrapping tablet: real 0.036s user 0.008s sys 0.004s
I20260808 08:36:56.484552 20336 tablet_bootstrap.cc:654] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff: Neither blocks nor log segments found. Creating new log.
I20260808 08:36:56.485850 20336 log.cc:824] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff: Log is configured to *not* fsync() on all Append() calls
I20260808 08:36:56.494824 20334 raft_consensus.cc:348] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "232fb3bd4525479caad2b78fa690953f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44321 } } peers { permanent_uuid: "ab87c6b342004cd99b25213de98bd438" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35751 } } peers { permanent_uuid: "df2b94c337924490ab6b870a3c4fffff" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35781 } }
I20260808 08:36:56.495393 20334 raft_consensus.cc:374] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:36:56.495543 20334 raft_consensus.cc:729] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab87c6b342004cd99b25213de98bd438, State: Initialized, Role: FOLLOWER
I20260808 08:36:56.496369 20334 consensus_queue.cc:260] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "232fb3bd4525479caad2b78fa690953f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44321 } } peers { permanent_uuid: "ab87c6b342004cd99b25213de98bd438" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35751 } } peers { permanent_uuid: "df2b94c337924490ab6b870a3c4fffff" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35781 } }
I20260808 08:36:56.504626 20334 ts_tablet_manager.cc:1428] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438: Time spent starting tablet: real 0.020s user 0.009s sys 0.009s
I20260808 08:36:56.505034 20310 heartbeater.cc:503] Master 127.5.164.254:42899 was elected leader, sending a full tablet report...
I20260808 08:36:56.518580 20336 tablet_bootstrap.cc:492] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff: No bootstrap required, opened a new log
I20260808 08:36:56.519014 20336 ts_tablet_manager.cc:1397] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff: Time spent bootstrapping tablet: real 0.040s user 0.007s sys 0.030s
W20260808 08:36:56.525338 20313 tablet.cc:2369] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:36:56.531359 20338 raft_consensus.cc:482] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:36:56.531677 20338 raft_consensus.cc:504] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "232fb3bd4525479caad2b78fa690953f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44321 } } peers { permanent_uuid: "ab87c6b342004cd99b25213de98bd438" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35751 } } peers { permanent_uuid: "df2b94c337924490ab6b870a3c4fffff" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35781 } }
I20260808 08:36:56.533829 20338 leader_election.cc:288] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab87c6b342004cd99b25213de98bd438 (127.5.164.195:35751), df2b94c337924490ab6b870a3c4fffff (127.5.164.194:35781)
I20260808 08:36:56.530884 20336 raft_consensus.cc:348] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "232fb3bd4525479caad2b78fa690953f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44321 } } peers { permanent_uuid: "ab87c6b342004cd99b25213de98bd438" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35751 } } peers { permanent_uuid: "df2b94c337924490ab6b870a3c4fffff" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35781 } }
I20260808 08:36:56.534571 20336 raft_consensus.cc:374] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:36:56.534716 20336 raft_consensus.cc:729] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df2b94c337924490ab6b870a3c4fffff, State: Initialized, Role: FOLLOWER
I20260808 08:36:56.535496 20336 consensus_queue.cc:260] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "232fb3bd4525479caad2b78fa690953f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44321 } } peers { permanent_uuid: "ab87c6b342004cd99b25213de98bd438" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35751 } } peers { permanent_uuid: "df2b94c337924490ab6b870a3c4fffff" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35781 } }
I20260808 08:36:56.536929 20166 heartbeater.cc:503] Master 127.5.164.254:42899 was elected leader, sending a full tablet report...
I20260808 08:36:56.537652 20336 ts_tablet_manager.cc:1428] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff: Time spent starting tablet: real 0.018s user 0.014s sys 0.000s
W20260808 08:36:56.565987 20167 tablet.cc:2369] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:36:56.572710 20328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.535429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:39857 (local address 127.5.164.194:35781)
0808 08:36:56.535758 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:56.535764 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:56.565315 (+ 29551us) server_negotiation.cc:407] Connection header received
0808 08:36:56.565499 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:56.565504 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:56.565604 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:56.565698 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:36:56.566499 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.567654 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.570125 (+ 2471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.571449 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.571594 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.571670 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:56.572259 (+ 589us) server_negotiation.cc:299] Negotiation successful
0808 08:36:56.572399 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197}
I20260808 08:36:56.573796 20341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.534546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:35781 (local address 127.5.164.193:39857)
0808 08:36:56.565169 (+ 30623us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:56.565191 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:36:56.565368 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:36:56.565887 (+ 519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:36:56.565892 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:36:56.565916 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:36:56.566314 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:56.566327 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.567858 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.567863 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:56.569952 (+ 2089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:56.569966 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.571866 (+ 1900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.571872 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:56.572061 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.572095 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:36:56.573226 (+ 1131us) client_negotiation.cc:240] Negotiation successful
0808 08:36:56.573385 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30483,"mutex_wait_us":4,"thread_start_us":8170,"threads_started":1}
I20260808 08:36:56.575091 20117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726a5284221d49738a44ec79811f193d" candidate_uuid: "232fb3bd4525479caad2b78fa690953f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df2b94c337924490ab6b870a3c4fffff" is_pre_election: true
I20260808 08:36:56.575724 20117 raft_consensus.cc:2454] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 232fb3bd4525479caad2b78fa690953f in term 0.
I20260808 08:36:56.575825 20332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.535093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:56933 (local address 127.5.164.195:35751)
0808 08:36:56.535366 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:56.535373 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:56.539769 (+ 4396us) server_negotiation.cc:407] Connection header received
0808 08:36:56.547925 (+ 8156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:56.547935 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:56.548054 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:56.548151 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:36:56.569277 (+ 21126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.570341 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.573343 (+ 3002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.574573 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.574720 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.574794 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:56.575449 (+ 655us) server_negotiation.cc:299] Negotiation successful
0808 08:36:56.575587 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260808 08:36:56.576651 20342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.534032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:35751 (local address 127.5.164.193:56933)
0808 08:36:56.539645 (+ 5613us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:56.539667 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:36:56.545384 (+ 5717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:36:56.563957 (+ 18573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:36:56.563966 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:36:56.564026 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:36:56.564566 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:56.569095 (+ 4529us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.570519 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.570524 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:56.573114 (+ 2590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:36:56.573130 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.574990 (+ 1860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.574996 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:36:56.575249 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.575283 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 08:36:56.576096 (+ 813us) client_negotiation.cc:240] Negotiation successful
0808 08:36:56.576241 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5483,"mutex_wait_us":599,"thread_start_us":30783,"threads_started":1}
I20260808 08:36:56.576758 19891 leader_election.cc:302] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 232fb3bd4525479caad2b78fa690953f, df2b94c337924490ab6b870a3c4fffff; no voters:
I20260808 08:36:56.584966 20338 raft_consensus.cc:2781] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:36:56.585183 20338 raft_consensus.cc:482] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:36:56.585295 20338 raft_consensus.cc:3037] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:36:56.588701 20338 raft_consensus.cc:504] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "232fb3bd4525479caad2b78fa690953f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44321 } } peers { permanent_uuid: "ab87c6b342004cd99b25213de98bd438" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35751 } } peers { permanent_uuid: "df2b94c337924490ab6b870a3c4fffff" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35781 } }
I20260808 08:36:56.590004 20263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726a5284221d49738a44ec79811f193d" candidate_uuid: "232fb3bd4525479caad2b78fa690953f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab87c6b342004cd99b25213de98bd438" is_pre_election: true
I20260808 08:36:56.590620 20263 raft_consensus.cc:2454] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 232fb3bd4525479caad2b78fa690953f in term 0.
I20260808 08:36:56.592685 20263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726a5284221d49738a44ec79811f193d" candidate_uuid: "232fb3bd4525479caad2b78fa690953f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab87c6b342004cd99b25213de98bd438"
I20260808 08:36:56.592888 20263 raft_consensus.cc:3037] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:36:56.593377 20338 leader_election.cc:288] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [CANDIDATE]: Term 1 election: Requested vote from peers ab87c6b342004cd99b25213de98bd438 (127.5.164.195:35751), df2b94c337924490ab6b870a3c4fffff (127.5.164.194:35781)
I20260808 08:36:56.596220 20263 raft_consensus.cc:2454] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 232fb3bd4525479caad2b78fa690953f in term 1.
I20260808 08:36:56.597100 20117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "726a5284221d49738a44ec79811f193d" candidate_uuid: "232fb3bd4525479caad2b78fa690953f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df2b94c337924490ab6b870a3c4fffff"
I20260808 08:36:56.597345 20117 raft_consensus.cc:3037] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:36:56.600613 20117 raft_consensus.cc:2454] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 232fb3bd4525479caad2b78fa690953f in term 1.
I20260808 08:36:56.600811 19889 leader_election.cc:302] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 232fb3bd4525479caad2b78fa690953f, ab87c6b342004cd99b25213de98bd438; no voters:
I20260808 08:36:56.601183 20338 raft_consensus.cc:2781] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:36:56.601795 20338 raft_consensus.cc:686] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [term 1 LEADER]: Becoming Leader. State: Replica: 232fb3bd4525479caad2b78fa690953f, State: Running, Role: LEADER
I20260808 08:36:56.602382 20338 consensus_queue.cc:237] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "232fb3bd4525479caad2b78fa690953f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44321 } } peers { permanent_uuid: "ab87c6b342004cd99b25213de98bd438" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35751 } } peers { permanent_uuid: "df2b94c337924490ab6b870a3c4fffff" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35781 } }
I20260808 08:36:56.608284 19802 catalog_manager.cc:5495] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f reported cstate change: term changed from 0 to 1, leader changed from <none> to 232fb3bd4525479caad2b78fa690953f (127.5.164.193). New cstate: current_term: 1 leader_uuid: "232fb3bd4525479caad2b78fa690953f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "232fb3bd4525479caad2b78fa690953f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab87c6b342004cd99b25213de98bd438" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df2b94c337924490ab6b870a3c4fffff" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35781 } health_report { overall_health: UNKNOWN } } }
I20260808 08:36:56.636412 20330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.627464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50992 (local address 127.5.164.193:44321)
0808 08:36:56.627691 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:56.627698 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:56.628257 (+ 559us) server_negotiation.cc:407] Connection header received
0808 08:36:56.628397 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:56.628402 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:56.628536 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:56.628688 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:36:56.629563 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.630737 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.632937 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.633534 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.633661 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.634397 (+ 736us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:36:56.635113 (+ 716us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:36:56.635304 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:56.636030 (+ 726us) server_negotiation.cc:299] Negotiation successful
0808 08:36:56.636119 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 08:36:56.650784 20117 raft_consensus.cc:1261] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff [term 1 FOLLOWER]: Refusing update from remote peer 232fb3bd4525479caad2b78fa690953f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:36:56.651211 20263 raft_consensus.cc:1261] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438 [term 1 FOLLOWER]: Refusing update from remote peer 232fb3bd4525479caad2b78fa690953f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:36:56.651824 20338 consensus_queue.cc:1035] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df2b94c337924490ab6b870a3c4fffff" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 35781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:36:56.652269 20344 consensus_queue.cc:1035] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab87c6b342004cd99b25213de98bd438" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 08:36:56.675823 20012 tablet.cc:2369] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:36:56.680184 20347 mvcc.cc:205] Tried to move back new op lower bound from 7316185975390965760 to 7316185975208181760. Current Snapshot: MvccSnapshot[applied={T|T < 7316185975390965760}]
I20260808 08:36:56.710275 19802 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:36:56.710623 19802 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:36:56.715533 19802 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fabcf28e375b460e9adb414e440d947c: Sending DeleteTablet for 3 replicas of tablet 726a5284221d49738a44ec79811f193d
I20260808 08:36:56.717101 19943 tablet_service.cc:1514] Processing DeleteTablet for tablet 726a5284221d49738a44ec79811f193d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:36:56 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:50982
I20260808 08:36:56.718180 20097 tablet_service.cc:1514] Processing DeleteTablet for tablet 726a5284221d49738a44ec79811f193d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:36:56 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:45244
I20260808 08:36:56.719203 20359 tablet_replica.cc:330] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff: stopping tablet replica
I20260808 08:36:56.720135 20241 tablet_service.cc:1514] Processing DeleteTablet for tablet 726a5284221d49738a44ec79811f193d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:36:56 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:34734
I20260808 08:36:56.724172 19941 tablet_service.cc:1514] Processing DeleteTablet for tablet 726a5284221d49738a44ec79811f193d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:36:56 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:50982
I20260808 08:36:56.725116 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 19840
I20260808 08:36:56.770494 20330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.727376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51008 (local address 127.5.164.193:44321)
0808 08:36:56.727609 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:56.727619 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:56.727642 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:36:56.727713 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:56.727721 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:56.727820 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:56.727936 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:56.738450 (+ 10514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.740191 (+ 1741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.743191 (+ 3000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.744156 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.744313 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.756829 (+ 12516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:56.756853 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:56.756882 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:56.756962 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:56.762584 (+ 5622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:56.765609 (+ 3025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:56.765624 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:56.765630 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:56.765852 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:56.766577 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:56.766585 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:56.766591 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:56.767214 (+ 623us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:56.767588 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:56.769614 (+ 2026us) server_negotiation.cc:299] Negotiation successful
0808 08:36:56.769948 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:36:56.773649 20005 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:36:56.772565 20357 tablet_replica.cc:330] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f: stopping tablet replica
I20260808 08:36:56.779403 20360 tablet_replica.cc:330] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438: stopping tablet replica
I20260808 08:36:56.779968 20360 raft_consensus.cc:2229] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:36:56.780550 20360 raft_consensus.cc:2258] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:36:56.783046 20360 ts_tablet_manager.cc:1905] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:36:56.785298 20359 raft_consensus.cc:2229] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:36:56.786402 20359 raft_consensus.cc:2258] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:36:56.788705 20359 ts_tablet_manager.cc:1905] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:36:56.794418 20360 ts_tablet_manager.cc:1918] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:36:56.794740 20360 log.cc:1196] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/726a5284221d49738a44ec79811f193d
I20260808 08:36:56.795455 20360 ts_tablet_manager.cc:1939] T 726a5284221d49738a44ec79811f193d P ab87c6b342004cd99b25213de98bd438: Deleting consensus metadata
I20260808 08:36:56.796105 20359 ts_tablet_manager.cc:1918] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:36:56.796272 20359 log.cc:1196] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/726a5284221d49738a44ec79811f193d
I20260808 08:36:56.796758 20359 ts_tablet_manager.cc:1939] T 726a5284221d49738a44ec79811f193d P df2b94c337924490ab6b870a3c4fffff: Deleting consensus metadata
I20260808 08:36:56.798156 19785 catalog_manager.cc:4841] TS ab87c6b342004cd99b25213de98bd438 (127.5.164.195:35751): tablet 726a5284221d49738a44ec79811f193d (table test-table [id=909c22c9a10f43c59acfe816da2a1941]) successfully deleted
I20260808 08:36:56.798332 19787 catalog_manager.cc:4841] TS df2b94c337924490ab6b870a3c4fffff (127.5.164.194:35781): tablet 726a5284221d49738a44ec79811f193d (table test-table [id=909c22c9a10f43c59acfe816da2a1941]) successfully deleted
I20260808 08:36:56.774945 20357 raft_consensus.cc:2229] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:36:56.903746 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 19840
I20260808 08:36:56.903777 20357 raft_consensus.cc:2258] T 726a5284221d49738a44ec79811f193d P 232fb3bd4525479caad2b78fa690953f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 08:36:56.925765 19785 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.164.193:44321 (error 108)
I20260808 08:36:56.926031 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 20015
I20260808 08:36:56.927603 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.927099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:44321 (local address 127.0.0.1:51014)
0808 08:36:56.927293 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:56.927422 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:44321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260808 08:36:56.927961 19785 catalog_manager.cc:4584] TS 232fb3bd4525479caad2b78fa690953f (127.5.164.193:44321): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 726a5284221d49738a44ec79811f193d: Network error: Client connection negotiation failed: client connection to 127.5.164.193:44321: connect: Connection refused (error 111)
I20260808 08:36:56.941854 20328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.927464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45256 (local address 127.5.164.194:35781)
0808 08:36:56.927678 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:56.927684 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:56.927704 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:36:56.927767 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:56.927772 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:56.927846 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:56.927947 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:56.929396 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.930558 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.932269 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:56.932702 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:56.932855 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:56.935615 (+ 2760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:56.935636 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:56.935651 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:56.935693 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:56.938675 (+ 2982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:56.939627 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:56.939635 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:56.939637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:56.939782 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:56.940186 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:56.940195 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:56.940197 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:56.940574 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:56.940885 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:56.941209 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 08:36:56.941478 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 08:36:56.942619 20161 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:36:56.973013 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.972402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:44321 (local address 127.0.0.1:51022)
0808 08:36:56.972674 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:56.972803 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:44321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260808 08:36:56.974251 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.973835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:44321 (local address 127.0.0.1:51034)
0808 08:36:56.974007 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:56.974104 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:44321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 08:36:56.981703 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.981227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:44321 (local address 127.0.0.1:51048)
0808 08:36:56.981426 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:56.981524 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:44321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260808 08:36:56.982856 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:56.982473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:44321 (local address 127.0.0.1:51054)
0808 08:36:56.982636 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:56.982721 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:44321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 08:36:57.023614 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:57.022984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:44321 (local address 127.0.0.1:51060)
0808 08:36:57.023279 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:57.023392 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:44321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260808 08:36:57.024948 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:57.024472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:44321 (local address 127.0.0.1:51070)
0808 08:36:57.024714 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:57.024803 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:44321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
I20260808 08:36:57.035699 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 20015
I20260808 08:36:57.057327 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 20170
I20260808 08:36:57.059589 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:57.059027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:44321 (local address 127.0.0.1:51072)
0808 08:36:57.059266 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:57.059379 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:44321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 08:36:57.060863 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:57.060384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:44321 (local address 127.0.0.1:51086)
0808 08:36:57.060630 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:57.060710 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:44321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260808 08:36:57.072234 20332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:57.058180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34742 (local address 127.5.164.195:35751)
0808 08:36:57.058364 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 08:36:57.058371 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:36:57.058393 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:36:57.058614 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:36:57.058620 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:36:57.058700 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:36:57.058807 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:36:57.060514 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:57.061482 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:57.062776 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:36:57.063415 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:36:57.063555 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:36:57.066462 (+ 2907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:36:57.066485 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:36:57.066501 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:36:57.066537 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:36:57.069334 (+ 2797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:57.070080 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:57.070087 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:57.070089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:57.070220 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:36:57.070629 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:36:57.070634 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:36:57.070638 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:36:57.071004 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:36:57.071494 (+ 490us) server_negotiation.cc:1035] Waiting for connection context
0808 08:36:57.071645 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 08:36:57.071871 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:36:57.072958 20304 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:36:57.125345 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:57.124833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:44321 (local address 127.0.0.1:51096)
0808 08:36:57.125064 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:57.125168 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:44321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 08:36:57.126400 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:57.126048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:44321 (local address 127.0.0.1:51104)
0808 08:36:57.126213 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:57.126290 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:44321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 08:36:57.161279 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 20170
I20260808 08:36:57.163507 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:57.162781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:44321 (local address 127.0.0.1:51106)
0808 08:36:57.163117 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:57.163272 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:44321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164}
I20260808 08:36:57.164706 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:36:57.164205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:44321 (local address 127.0.0.1:51122)
0808 08:36:57.164425 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 08:36:57.164545 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:44321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260808 08:36:57.180074 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 19765
I20260808 08:36:57.181262 19833 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:36:57.294840 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 19765
I20260808 08:36:57.324604 5779 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 08:36:57.669708 5779 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 08:36:57.669970 5779 mini_ranger.cc:66] Stopping Ranger...
I20260808 08:36:58.014946 5779 mini_ranger.cc:68] Stopped Ranger
2026-08-08 08:36:58.015 UTC [18735] LOG: received smart shutdown request
2026-08-08 08:36:58.018 UTC [18735] LOG: background worker "logical replication launcher" (PID 18746) exited with exit code 1
2026-08-08 08:36:58.018 UTC [18741] LOG: shutting down
2026-08-08 08:36:58.190 UTC [18735] LOG: database system is shut down
2026-08-08T08:36:58Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (56186 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:36:58 dist-test-slave-chsk krb5kdc[20380](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:36:58 dist-test-slave-chsk krb5kdc[20380](info): set up 2 sockets
Aug 08 08:36:58 dist-test-slave-chsk krb5kdc[20380](info): commencing operation
krb5kdc: starting...
W20260808 08:36:59.484606 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.001s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:36:59 dist-test-slave-chsk krb5kdc[20380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:36:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:36:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:36:59.774920 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:35807
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:35807,127.5.164.253:44071,127.5.164.252:33207
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:37:00.120850 20395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:00.121176 20395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:00.121335 20395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:00.128979 20395 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:37:00.129119 20395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:00.129207 20395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:00.129298 20395 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:37:00.129407 20395 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:37:00.140025 20395 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:35807,127.5.164.253:44071,127.5.164.252:33207
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:35807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:00.141495 20395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:00.142874 20395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:00.155133 20400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:00.155115 20401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:00.155704 20403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:00.156271 20395 server_base.cc:1034] running on GCE node
I20260808 08:37:00.157174 20395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:00.158646 20395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:00.159883 20395 hybrid_clock.cc:648] HybridClock initialized: now 1786178220159831 us; error 27 us; skew 500 ppm
I20260808 08:37:00.160257 20395 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:00 dist-test-slave-chsk krb5kdc[20380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178220, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:00.167870 20395 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:37:00.169559 20395 webserver.cc:460] Webserver started at http://127.5.164.254:38745/ using document root <none> and password file <none>
I20260808 08:37:00.170282 20395 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:00.170423 20395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:00.170775 20395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:37:00.173964 20395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "80ad78772b9146dab06f200037c3a434"
format_stamp: "Formatted at 2026-08-08 08:37:00 on dist-test-slave-chsk"
server_key: "403cb256007dc80aea9621c7e0ee5300"
server_key_iv: "4a1b68f04d1aade1786c95a40287a6e4"
server_key_version: "encryptionkey@0"
I20260808 08:37:00.174845 20395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "80ad78772b9146dab06f200037c3a434"
format_stamp: "Formatted at 2026-08-08 08:37:00 on dist-test-slave-chsk"
server_key: "403cb256007dc80aea9621c7e0ee5300"
server_key_iv: "4a1b68f04d1aade1786c95a40287a6e4"
server_key_version: "encryptionkey@0"
I20260808 08:37:00.180373 20395 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 08:37:00.184134 20411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:00.185498 20395 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:37:00.185701 20395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "80ad78772b9146dab06f200037c3a434"
format_stamp: "Formatted at 2026-08-08 08:37:00 on dist-test-slave-chsk"
server_key: "403cb256007dc80aea9621c7e0ee5300"
server_key_iv: "4a1b68f04d1aade1786c95a40287a6e4"
server_key_version: "encryptionkey@0"
I20260808 08:37:00.185927 20395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:00.202996 20395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:00.207625 20395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:00.207881 20395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:00.227768 20395 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:35807
I20260808 08:37:00.227818 20463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:35807 every 8 connection(s)
I20260808 08:37:00.229296 20395 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:37:00.231889 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 20395
I20260808 08:37:00.232143 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:37:00.232883 5779 external_mini_cluster.cc:1428] Setting key 6a16987c2a57e220c0bc0bedcac4792a
I20260808 08:37:00.233405 20464 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:00.240314 20464 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:37:00 dist-test-slave-chsk krb5kdc[20380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178220, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.164.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.253@KRBTEST.COM" created.
I20260808 08:37:00.264292 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.244158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:35807 (local address 127.0.0.1:41808)
0808 08:37:00.245485 (+ 1327us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.245518 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:00.247389 (+ 1871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:00.248213 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:00.248220 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:00.248949 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:00.249282 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:00.249299 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:00.250858 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:00.250864 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:00.252037 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:00.252050 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:00.252991 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:00.252998 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:00.253241 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:00.253937 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:00.253960 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:00.256454 (+ 2494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:00.259961 (+ 3507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:00.259974 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:00.259988 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:00.260386 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:00.260807 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:00.260813 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:00.260816 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:00.260974 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:00.261761 (+ 787us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:00.261769 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:00.261977 (+ 208us) client_negotiation.cc:769] Sending connection context
0808 08:37:00.262248 (+ 271us) client_negotiation.cc:240] Negotiation successful
0808 08:37:00.262871 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1130,"mutex_wait_us":165,"spinlock_wait_cycles":41216,"thread_start_us":950,"threads_started":1}
I20260808 08:37:00.264328 20467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.244157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41808 (local address 127.5.164.254:35807)
0808 08:37:00.245047 (+ 890us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:00.245057 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:00.245651 (+ 594us) server_negotiation.cc:407] Connection header received
0808 08:37:00.247753 (+ 2102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:00.247759 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:00.247981 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:00.248196 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:00.249484 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:00.250698 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:00.252179 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:00.252743 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:00.252954 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:00.256700 (+ 3746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:00.256709 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:00.256722 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:00.256752 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:00.259831 (+ 3079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:00.260529 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:00.260542 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:00.260544 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:00.260693 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:00.261105 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:00.261109 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:00.261111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:00.261613 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:00.261827 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:00.262372 (+ 545us) server_negotiation.cc:299] Negotiation successful
0808 08:37:00.262757 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":77,"server-negotiator.queue_time_us":695,"thread_start_us":472,"threads_started":1}
I20260808 08:37:00.267376 20464 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:37:00.268558 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.268024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:44071 (local address 127.0.0.1:42244)
0808 08:37:00.268242 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.268382 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:44071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260808 08:37:00.273353 20414 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.164.253:44071: connect: Connection refused (error 111)
I20260808 08:37:00.275205 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.274760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:44071 (local address 127.0.0.1:42246)
0808 08:37:00.274927 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.275010 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:44071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 08:37:00.275415 20464 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.253:44071: Network error: Client connection negotiation failed: client connection to 127.5.164.253:44071: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.253.keytab.
Entry for principal kudu/127.5.164.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.253.keytab.
I20260808 08:37:00.296777 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.253:44071
--webserver_interface=127.5.164.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.253.keytab
--principal=kudu/127.5.164.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:35807,127.5.164.253:44071,127.5.164.252:33207
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:37:00.324882 20464 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } attempt: 1
I20260808 08:37:00.326218 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.325674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:44071 (local address 127.0.0.1:42262)
0808 08:37:00.325908 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.326053 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:44071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260808 08:37:00.327337 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.326920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:44071 (local address 127.0.0.1:42270)
0808 08:37:00.327070 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.327173 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:44071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 08:37:00.327548 20464 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.253:44071: Network error: Client connection negotiation failed: client connection to 127.5.164.253:44071: connect: Connection refused (error 111)
I20260808 08:37:00.395838 20464 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } attempt: 2
I20260808 08:37:00.397178 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.396593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:44071 (local address 127.0.0.1:42272)
0808 08:37:00.396879 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.397002 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:44071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260808 08:37:00.398422 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.397926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:44071 (local address 127.0.0.1:42278)
0808 08:37:00.398129 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.398238 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:44071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 08:37:00.398651 20464 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.253:44071: Network error: Client connection negotiation failed: client connection to 127.5.164.253:44071: connect: Connection refused (error 111)
I20260808 08:37:00.489928 20464 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } attempt: 3
I20260808 08:37:00.491240 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.490638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:44071 (local address 127.0.0.1:42292)
0808 08:37:00.490920 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.491030 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:44071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
I20260808 08:37:00.492457 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.491951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:44071 (local address 127.0.0.1:42304)
0808 08:37:00.492135 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.492256 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:44071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 08:37:00.492694 20464 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.253:44071: Network error: Client connection negotiation failed: client connection to 127.5.164.253:44071: connect: Connection refused (error 111)
I20260808 08:37:00.635988 20464 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } attempt: 4
I20260808 08:37:00.637296 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.636682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:44071 (local address 127.0.0.1:42314)
0808 08:37:00.637005 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.637129 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:44071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
I20260808 08:37:00.638307 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.637928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:44071 (local address 127.0.0.1:42326)
0808 08:37:00.638073 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.638166 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:44071: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 08:37:00.638491 20464 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.253:44071: Network error: Client connection negotiation failed: client connection to 127.5.164.253:44071: connect: Connection refused (error 111)
W20260808 08:37:00.639511 20471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:00.639772 20471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:00.639885 20471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:00.647305 20471 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:37:00.647436 20471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:00.647490 20471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:00.647549 20471 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:37:00.647593 20471 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:37:00.658435 20471 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:35807,127.5.164.253:44071,127.5.164.252:33207
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.253.keytab
--principal=kudu/127.5.164.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.253:44071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.5.164.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:00.659983 20471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:00.661311 20471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:00.673108 20476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:00.673208 20479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:00.673151 20477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:00.674561 20471 server_base.cc:1034] running on GCE node
I20260808 08:37:00.675540 20471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:00.677120 20471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:00.678387 20471 hybrid_clock.cc:648] HybridClock initialized: now 1786178220678354 us; error 49 us; skew 500 ppm
I20260808 08:37:00.678788 20471 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:00 dist-test-slave-chsk krb5kdc[20380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178220, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:00.682085 20471 init.cc:377] Logged in from keytab as kudu/127.5.164.253@KRBTEST.COM (short username kudu)
I20260808 08:37:00.683688 20471 webserver.cc:460] Webserver started at http://127.5.164.253:35085/ using document root <none> and password file <none>
I20260808 08:37:00.684444 20471 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:00.684604 20471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:00.684926 20471 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:37:00.688221 20471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/data/instance:
uuid: "96081244abe34904b4c137a335b0ca1c"
format_stamp: "Formatted at 2026-08-08 08:37:00 on dist-test-slave-chsk"
server_key: "e0d3689097c39e016d28136897641abc"
server_key_iv: "d0823f36128e5718d5e7ba65eb0424c8"
server_key_version: "encryptionkey@0"
I20260808 08:37:00.689145 20471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/wal/instance:
uuid: "96081244abe34904b4c137a335b0ca1c"
format_stamp: "Formatted at 2026-08-08 08:37:00 on dist-test-slave-chsk"
server_key: "e0d3689097c39e016d28136897641abc"
server_key_iv: "d0823f36128e5718d5e7ba65eb0424c8"
server_key_version: "encryptionkey@0"
I20260808 08:37:00.695051 20471 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 08:37:00.698585 20486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:00.699999 20471 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:37:00.700188 20471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/wal
uuid: "96081244abe34904b4c137a335b0ca1c"
format_stamp: "Formatted at 2026-08-08 08:37:00 on dist-test-slave-chsk"
server_key: "e0d3689097c39e016d28136897641abc"
server_key_iv: "d0823f36128e5718d5e7ba65eb0424c8"
server_key_version: "encryptionkey@0"
I20260808 08:37:00.700398 20471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:00.721158 20471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:00.725189 20471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:00.725493 20471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:00.745064 20471 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.253:44071
I20260808 08:37:00.745088 20541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.253:44071 every 8 connection(s)
I20260808 08:37:00.746480 20471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/data/info.pb
I20260808 08:37:00.750128 20542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:00.755816 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 20471
I20260808 08:37:00.756027 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-1/wal/instance
I20260808 08:37:00.756489 5779 external_mini_cluster.cc:1428] Setting key caf942babde9b42b47023942bd4e3096
I20260808 08:37:00.756918 20542 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:37:00 dist-test-slave-chsk krb5kdc[20380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178220, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.253@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:00.778577 20467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.759689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41824 (local address 127.5.164.254:35807)
0808 08:37:00.759878 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:00.759883 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:00.761331 (+ 1448us) server_negotiation.cc:407] Connection header received
0808 08:37:00.763323 (+ 1992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:00.763329 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:00.763435 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:00.763551 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:00.765095 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:00.765772 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:00.767423 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:00.767867 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:00.768006 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:00.772059 (+ 4053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:00.772065 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:00.772068 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:00.772103 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:00.774896 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:00.776020 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:00.776025 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:00.776027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:00.776157 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:00.776726 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:00.776729 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:00.776731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:00.777020 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:00.777137 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:00.778123 (+ 986us) server_negotiation.cc:299] Negotiation successful
0808 08:37:00.778332 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:37:00.780375 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.760264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:35807 (local address 127.0.0.1:41824)
0808 08:37:00.761139 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.761187 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:00.762985 (+ 1798us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:00.763802 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:00.763810 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:00.764346 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:00.764907 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:00.764923 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:00.765947 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:00.765952 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:00.767275 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:00.767287 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:00.768129 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:00.768138 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:00.768357 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:00.769067 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:00.769090 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:00.771779 (+ 2689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:00.775097 (+ 3318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:00.775110 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:00.775131 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:00.775887 (+ 756us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:00.776276 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:00.776283 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:00.776289 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:00.776600 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:00.777158 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:00.777170 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:00.777701 (+ 531us) client_negotiation.cc:769] Sending connection context
0808 08:37:00.778027 (+ 326us) client_negotiation.cc:240] Negotiation successful
0808 08:37:00.778709 (+ 682us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":371,"threads_started":1}
I20260808 08:37:00.782343 20542 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.5.164.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.252@KRBTEST.COM" created.
Aug 08 08:37:00 dist-test-slave-chsk krb5kdc[20380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178220, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.253@KRBTEST.COM for kudu/127.5.164.253@KRBTEST.COM
I20260808 08:37:00.799471 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.783353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:44071 (local address 127.0.0.1:42340)
0808 08:37:00.783611 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.783638 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:00.783770 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:00.784771 (+ 1001us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:00.784778 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:00.785321 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:00.785521 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:00.785532 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:00.786942 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:00.786946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:00.788024 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:00.788037 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:00.789135 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:00.789140 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:00.789315 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:00.790042 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:00.790060 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:00.792204 (+ 2144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:00.796822 (+ 4618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:00.796826 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:00.796828 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:00.797293 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:00.797745 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:00.797749 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:00.797751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:00.797880 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:00.798685 (+ 805us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:00.798688 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:00.798804 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 08:37:00.798907 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 08:37:00.799128 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":1}
I20260808 08:37:00.800019 20547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.783565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42340 (local address 127.5.164.253:44071)
0808 08:37:00.784306 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:00.784312 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:00.784338 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:37:00.784383 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:00.784389 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:00.784570 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:00.784694 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:00.785692 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:00.786811 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:00.788216 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:00.788980 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:00.789146 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:00.792447 (+ 3301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:00.792467 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:00.792489 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:00.792542 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:00.796658 (+ 4116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:00.797443 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:00.797456 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:00.797462 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:00.797633 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:00.798000 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:00.798008 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:00.798013 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:00.798541 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:00.798768 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:00.799121 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 08:37:00.799448 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":580,"spinlock_wait_cycles":23808,"thread_start_us":426,"threads_started":1}
I20260808 08:37:00.802567 20542 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:37:00.803910 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.803399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40650)
0808 08:37:00.803637 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.803757 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
W20260808 08:37:00.804306 20487 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
I20260808 08:37:00.805881 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.805557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40660)
0808 08:37:00.805697 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.805776 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 08:37:00.806193 20542 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:33207: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.252.keytab.
Entry for principal kudu/127.5.164.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.252.keytab.
I20260808 08:37:00.825999 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.252:33207
--webserver_interface=127.5.164.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.252.keytab
--principal=kudu/127.5.164.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:35807,127.5.164.253:44071,127.5.164.252:33207
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:37:00.855520 20542 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } attempt: 1
I20260808 08:37:00.856865 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.856308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40670)
0808 08:37:00.856567 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.856708 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 08:37:00.857939 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.857574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40684)
0808 08:37:00.857763 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.857829 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 08:37:00.858172 20542 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:33207: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
I20260808 08:37:00.926435 20542 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } attempt: 2
I20260808 08:37:00.927706 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.927231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40690)
0808 08:37:00.927437 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.927538 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 08:37:00.928740 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.928406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40702)
0808 08:37:00.928550 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.928626 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 08:37:00.929001 20542 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:33207: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
I20260808 08:37:00.937749 20464 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } attempt: 5
Aug 08 08:37:00 dist-test-slave-chsk krb5kdc[20380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178220, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for kudu/127.5.164.253@KRBTEST.COM
I20260808 08:37:00.953248 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.938470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:44071 (local address 127.0.0.1:42352)
0808 08:37:00.938708 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.938732 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:00.938868 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:00.939324 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:00.939330 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:00.939860 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:00.940153 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:00.940166 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:00.941244 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:00.941252 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:00.942934 (+ 1682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:00.942950 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:00.943737 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:00.943743 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:00.943932 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:00.944585 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:00.944607 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:00.947022 (+ 2415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:00.950892 (+ 3870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:00.950896 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:00.950899 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:00.951362 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:00.951773 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:00.951776 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:00.951778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:00.951909 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:00.952502 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:00.952505 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:00.952651 (+ 146us) client_negotiation.cc:769] Sending connection context
0808 08:37:00.952759 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 08:37:00.952989 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 08:37:00.953444 20547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.938591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42352 (local address 127.5.164.253:44071)
0808 08:37:00.938784 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:00.938788 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:00.938809 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:37:00.939029 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:00.939033 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:00.939107 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:00.939263 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:00.940326 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:00.941084 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:00.943087 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:00.943569 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:00.943671 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:00.947255 (+ 3584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:00.947262 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:00.947267 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:00.947309 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:00.950740 (+ 3431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:00.951483 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:00.951489 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:00.951492 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:00.951655 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:00.952012 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:00.952016 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:00.952019 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:00.952386 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:00.952523 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:00.952903 (+ 380us) server_negotiation.cc:299] Negotiation successful
0808 08:37:00.953132 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:37:00.954541 20464 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:37:00.955667 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.955276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40716)
0808 08:37:00.955440 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.955518 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 08:37:00.956648 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:00.956316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40722)
0808 08:37:00.956455 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:00.956547 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 08:37:00.956881 20464 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:33207: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
I20260808 08:37:01.008121 20464 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } attempt: 1
I20260808 08:37:01.009483 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.008845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40738)
0808 08:37:01.009135 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:01.009267 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260808 08:37:01.010689 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.010187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40754)
0808 08:37:01.010393 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:01.010510 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 08:37:01.010962 20464 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:33207: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
I20260808 08:37:01.020262 20542 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } attempt: 3
I20260808 08:37:01.021526 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.021042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40764)
0808 08:37:01.021261 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:01.021355 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260808 08:37:01.022688 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.022245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40780)
0808 08:37:01.022493 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:01.022574 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132}
W20260808 08:37:01.022965 20542 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:33207: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
I20260808 08:37:01.079288 20464 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } attempt: 2
I20260808 08:37:01.080703 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.080012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40788)
0808 08:37:01.080311 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:01.080447 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 08:37:01.081947 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.081507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40802)
0808 08:37:01.081687 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:01.081790 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 08:37:01.082267 20464 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:33207: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
I20260808 08:37:01.166229 20542 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } attempt: 4
I20260808 08:37:01.167552 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.166989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40806)
0808 08:37:01.167292 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:01.167385 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 08:37:01.168507 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.168194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40818)
0808 08:37:01.168337 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:01.168410 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 08:37:01.168763 20542 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:33207: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
W20260808 08:37:01.180203 20551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:01.180562 20551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:01.180727 20551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:01.188491 20551 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
I20260808 08:37:01.188499 20464 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } attempt: 3
W20260808 08:37:01.188660 20551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:01.188745 20551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:01.188833 20551 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:37:01.188925 20551 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:37:01.189836 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.189250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40826)
0808 08:37:01.189488 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:01.189601 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 08:37:01.190936 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.190519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40840)
0808 08:37:01.190722 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:01.190805 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
W20260808 08:37:01.191159 20464 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:33207: Network error: Client connection negotiation failed: client connection to 127.5.164.252:33207: connect: Connection refused (error 111)
I20260808 08:37:01.199939 20551 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:35807,127.5.164.253:44071,127.5.164.252:33207
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.252.keytab
--principal=kudu/127.5.164.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.252:33207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.5.164.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:01.201316 20551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:01.202662 20551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:01.215438 20559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:01.215543 20557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:01.215488 20556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:01.220898 20551 server_base.cc:1034] running on GCE node
I20260808 08:37:01.221781 20551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:01.223501 20551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:01.224728 20551 hybrid_clock.cc:648] HybridClock initialized: now 1786178221224666 us; error 69 us; skew 500 ppm
I20260808 08:37:01.225106 20551 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:01 dist-test-slave-chsk krb5kdc[20380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178221, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:01.228767 20551 init.cc:377] Logged in from keytab as kudu/127.5.164.252@KRBTEST.COM (short username kudu)
I20260808 08:37:01.230643 20551 webserver.cc:460] Webserver started at http://127.5.164.252:42845/ using document root <none> and password file <none>
I20260808 08:37:01.231613 20551 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:01.231778 20551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:01.232153 20551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:37:01.236657 20551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/data/instance:
uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba"
format_stamp: "Formatted at 2026-08-08 08:37:01 on dist-test-slave-chsk"
server_key: "ec68de7eee0d195ea62b62386befffdf"
server_key_iv: "aacb54f22d8f1e9b3f24b33c842fed13"
server_key_version: "encryptionkey@0"
I20260808 08:37:01.237777 20551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/wal/instance:
uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba"
format_stamp: "Formatted at 2026-08-08 08:37:01 on dist-test-slave-chsk"
server_key: "ec68de7eee0d195ea62b62386befffdf"
server_key_iv: "aacb54f22d8f1e9b3f24b33c842fed13"
server_key_version: "encryptionkey@0"
I20260808 08:37:01.244014 20551 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260808 08:37:01.249089 20566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:01.250727 20551 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260808 08:37:01.250931 20551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/wal
uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba"
format_stamp: "Formatted at 2026-08-08 08:37:01 on dist-test-slave-chsk"
server_key: "ec68de7eee0d195ea62b62386befffdf"
server_key_iv: "aacb54f22d8f1e9b3f24b33c842fed13"
server_key_version: "encryptionkey@0"
I20260808 08:37:01.251226 20551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:01.273681 20551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:01.278270 20551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:01.278590 20551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:01.297472 20551 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.252:33207
I20260808 08:37:01.297516 20618 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.252:33207 every 8 connection(s)
I20260808 08:37:01.298868 20551 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/data/info.pb
I20260808 08:37:01.302601 20619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:01.305756 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 20551
I20260808 08:37:01.305961 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786178004478096-5779-0/minicluster-data/master-2/wal/instance
I20260808 08:37:01.306545 5779 external_mini_cluster.cc:1428] Setting key c642f454c42733748c01481241c5d5f5
I20260808 08:37:01.310918 20619 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:37:01 dist-test-slave-chsk krb5kdc[20380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178221, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.252@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
Aug 08 08:37:01 dist-test-slave-chsk krb5kdc[20380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.252@KRBTEST.COM
I20260808 08:37:01.330536 20623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.314274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41828 (local address 127.5.164.254:35807)
0808 08:37:01.314878 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:01.314885 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:01.315417 (+ 532us) server_negotiation.cc:407] Connection header received
0808 08:37:01.315642 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:01.315654 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:01.315721 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:01.315838 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:01.316995 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.317813 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.319305 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.319734 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.319874 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:01.323532 (+ 3658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:01.323538 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:01.323541 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:01.323576 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:01.327020 (+ 3444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.327905 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.327910 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.327912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.328039 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.328533 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.328538 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.328541 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.328928 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:01.329038 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:01.329856 (+ 818us) server_negotiation.cc:299] Negotiation successful
0808 08:37:01.330099 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":308,"threads_started":1}
I20260808 08:37:01.331638 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.314271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:35807 (local address 127.0.0.1:41828)
0808 08:37:01.315271 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:01.315318 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:01.315507 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:01.315899 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:01.315906 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:01.316555 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:01.316829 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:01.316838 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.317983 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.317997 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:01.319113 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:01.319125 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.319968 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.319975 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:01.320135 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:01.320801 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:01.320824 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:01.323322 (+ 2498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:01.327216 (+ 3894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:01.327227 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:01.327236 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:01.327771 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:01.328158 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:01.328165 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:01.328169 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:01.328401 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:01.329063 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:01.329074 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:01.329453 (+ 379us) client_negotiation.cc:769] Sending connection context
0808 08:37:01.329717 (+ 264us) client_negotiation.cc:240] Negotiation successful
0808 08:37:01.330245 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"thread_start_us":546,"threads_started":1}
I20260808 08:37:01.331677 20622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.308656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40844 (local address 127.5.164.252:33207)
0808 08:37:01.309508 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:01.309519 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:01.309561 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:37:01.311299 (+ 1738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:01.311321 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:01.311734 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:01.312062 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:01.314068 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.316154 (+ 2086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.317815 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.318603 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.318817 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:01.324077 (+ 5260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:01.324091 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:01.324111 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:01.324150 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:01.327690 (+ 3540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.328544 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.328552 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.328555 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.328712 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.329126 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.329130 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.329132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.329550 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:01.329829 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:01.330198 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 08:37:01.330441 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"spinlock_wait_cycles":15232,"thread_start_us":433,"threads_started":1}
I20260808 08:37:01.334192 20619 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:37:01 dist-test-slave-chsk krb5kdc[20380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178221, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.252@KRBTEST.COM for kudu/127.5.164.253@KRBTEST.COM
Aug 08 08:37:01 dist-test-slave-chsk krb5kdc[20380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:01.350785 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.335020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:44071 (local address 127.0.0.1:42364)
0808 08:37:01.335219 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:01.335237 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:01.335329 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:01.335973 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:01.335977 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:01.336352 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:01.336498 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:01.336506 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.337929 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.337935 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:01.339461 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:01.339478 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.340531 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.340536 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:01.340783 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:01.341707 (+ 924us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:01.341732 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:01.344553 (+ 2821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:01.348074 (+ 3521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:01.348082 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:01.348086 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:01.348633 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:01.349030 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:01.349035 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:01.349039 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:01.349201 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:01.349738 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:01.349742 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:01.349914 (+ 172us) client_negotiation.cc:769] Sending connection context
0808 08:37:01.350059 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 08:37:01.350373 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 08:37:01.350827 20547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.335482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42364 (local address 127.5.164.253:44071)
0808 08:37:01.335717 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:01.335722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:01.335735 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:37:01.335782 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:01.335785 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:01.335840 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:01.335947 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:01.336647 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.337726 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.339620 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.340322 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.340480 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:01.344797 (+ 4317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:01.344807 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:01.344814 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:01.344866 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:01.347909 (+ 3043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.348764 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.348768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.348770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.348902 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.349336 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.349340 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.349343 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.349612 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:01.349785 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:01.350208 (+ 423us) server_negotiation.cc:299] Negotiation successful
0808 08:37:01.350428 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 08:37:01.351814 20623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.334895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41830 (local address 127.5.164.254:35807)
0808 08:37:01.335077 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:01.335083 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:01.335105 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:37:01.335358 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:01.335365 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:01.335451 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:01.335531 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:01.336814 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.337849 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.339746 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.340379 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.340495 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:01.345792 (+ 5297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:01.345797 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:01.345801 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:01.345834 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:01.348814 (+ 2980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.349554 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.349559 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.349561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.349683 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.350093 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.350103 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.350105 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.350377 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:01.350685 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:01.351372 (+ 687us) server_negotiation.cc:299] Negotiation successful
0808 08:37:01.351601 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 08:37:01.352571 20619 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:37:01 dist-test-slave-chsk krb5kdc[20380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178221, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.252@KRBTEST.COM for kudu/127.5.164.252@KRBTEST.COM
Aug 08 08:37:01 dist-test-slave-chsk krb5kdc[20380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.253@KRBTEST.COM
I20260808 08:37:01.367314 20622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.353384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40850 (local address 127.5.164.252:33207)
0808 08:37:01.353749 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:01.353755 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:01.353774 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:37:01.353826 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:01.353831 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:01.353911 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:01.354010 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:01.354845 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.356007 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.357598 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.358266 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.358390 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:01.361850 (+ 3460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:01.361858 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:01.361864 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:01.361906 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:01.364774 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.365381 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.365389 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.365392 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.365512 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.365876 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.365883 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.365886 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.366161 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:01.366311 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:01.366647 (+ 336us) server_negotiation.cc:299] Negotiation successful
0808 08:37:01.366878 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":256}
I20260808 08:37:01.367583 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.353447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40850)
0808 08:37:01.353597 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:01.353626 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:01.353733 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:01.354062 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:01.354067 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:01.354569 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:01.354716 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:01.354725 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.356140 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.356147 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:01.357469 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:01.357481 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.358405 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.358409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:01.358614 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:01.359235 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:01.359259 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:01.361634 (+ 2375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:01.364905 (+ 3271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:01.364912 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:01.364916 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:01.365266 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:01.365622 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:01.365630 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:01.365634 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:01.365772 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:01.366274 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:01.366278 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:01.366423 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 08:37:01.366562 (+ 139us) client_negotiation.cc:240] Negotiation successful
0808 08:37:01.367026 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":175}
I20260808 08:37:01.368394 20464 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } attempt: 4
I20260808 08:37:01.370888 20547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.353626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42376 (local address 127.5.164.253:44071)
0808 08:37:01.353792 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:01.353799 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:01.353878 (+ 79us) server_negotiation.cc:407] Connection header received
0808 08:37:01.354073 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:01.354078 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:01.354161 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:01.354267 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:01.356019 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.357168 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.358840 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.359481 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.359618 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:01.364583 (+ 4965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:01.364588 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:01.364591 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:01.364625 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:01.367317 (+ 2692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.368408 (+ 1091us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.368414 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.368420 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.368595 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.369037 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.369042 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.369046 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.369450 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:01.369708 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:01.370273 (+ 565us) server_negotiation.cc:299] Negotiation successful
0808 08:37:01.370524 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:37:01.373754 20619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba: Bootstrap starting.
Aug 08 08:37:01 dist-test-slave-chsk krb5kdc[20380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178220, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for kudu/127.5.164.252@KRBTEST.COM
I20260808 08:37:01.378031 20619 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:01.379565 20619 log.cc:824] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:01.380544 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:37:01.383050 20619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba: No bootstrap required, opened a new log
I20260808 08:37:01.384923 20468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.369090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40854)
0808 08:37:01.369304 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:01.369324 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:01.369436 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:01.369931 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:01.369936 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:01.370458 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:01.370681 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:01.370695 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.371925 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.371930 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:01.372898 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:01.372909 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.373651 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.373656 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:01.373871 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:01.374511 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:01.374541 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:01.377279 (+ 2738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:01.381855 (+ 4576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:01.381861 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:01.381866 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:01.382411 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:01.382878 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:01.382886 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:01.382891 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:01.383106 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:01.383907 (+ 801us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:01.383912 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:01.384084 (+ 172us) client_negotiation.cc:769] Sending connection context
0808 08:37:01.384216 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 08:37:01.384523 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 08:37:01.386134 20622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.369451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40854 (local address 127.5.164.252:33207)
0808 08:37:01.369631 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:01.369637 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:01.369654 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:37:01.369699 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:01.369703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:01.369771 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:01.369870 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:01.370852 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.371773 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.373047 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.373496 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.373627 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:01.377488 (+ 3861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:01.377494 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:01.377498 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:01.377536 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:01.381698 (+ 4162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.382550 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.382556 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.382559 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.382741 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.383260 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.383265 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.383268 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.383739 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:01.385333 (+ 1594us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:01.385481 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 08:37:01.385739 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:37:01.392481 20464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434: Bootstrap starting.
I20260808 08:37:01.394256 20619 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } }
I20260808 08:37:01.397022 20464 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:01.398488 20464 log.cc:824] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:01.398916 20619 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:01.399089 20619 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eaa8d75f88345a69f0dc22a3ffd2aba, State: Initialized, Role: FOLLOWER
I20260808 08:37:01.400059 20619 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } }
I20260808 08:37:01.405509 20635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } } }
I20260808 08:37:01.406774 20464 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434: No bootstrap required, opened a new log
I20260808 08:37:01.407966 20635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:37:01.407838 20619 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:37:01.415359 20623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.387430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41842 (local address 127.5.164.254:35807)
0808 08:37:01.387804 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:01.387813 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:01.395594 (+ 7781us) server_negotiation.cc:407] Connection header received
0808 08:37:01.395918 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:01.395924 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:01.396014 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:01.396095 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:01.398851 (+ 2756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.399939 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.402475 (+ 2536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.403132 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.403259 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:01.407397 (+ 4138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:01.407405 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:01.407412 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:01.407459 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:01.411674 (+ 4215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.412611 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.412620 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.412625 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.412788 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.413296 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.413303 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.413308 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.413748 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:01.414030 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:01.414644 (+ 614us) server_negotiation.cc:299] Negotiation successful
0808 08:37:01.414915 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187}
I20260808 08:37:01.417532 20622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.391337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40868 (local address 127.5.164.252:33207)
0808 08:37:01.399327 (+ 7990us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:01.399334 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:01.399354 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:37:01.399407 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:01.399413 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:01.399507 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:01.399600 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:01.402164 (+ 2564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.403306 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.405720 (+ 2414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.406464 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.406573 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:01.410309 (+ 3736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:01.410317 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:01.410322 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:01.410367 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:01.414163 (+ 3796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.415019 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.415025 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.415029 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.415198 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.415707 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.415712 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.415715 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.416075 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:01.416314 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:01.416906 (+ 592us) server_negotiation.cc:299] Negotiation successful
0808 08:37:01.417157 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7849}
I20260808 08:37:01.423390 20464 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } }
I20260808 08:37:01.423863 20464 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:01.424016 20464 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80ad78772b9146dab06f200037c3a434, State: Initialized, Role: FOLLOWER
I20260808 08:37:01.424837 20464 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } }
I20260808 08:37:01.426009 20641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } } }
I20260808 08:37:01.426445 20641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:37:01.427709 20464 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:37:01.430160 20635 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:37:01.430454 20635 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } }
I20260808 08:37:01.432232 20635 leader_election.cc:288] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80ad78772b9146dab06f200037c3a434 (127.5.164.254:35807), 96081244abe34904b4c137a335b0ca1c (127.5.164.253:44071)
I20260808 08:37:01.433820 20547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.387974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42388 (local address 127.5.164.253:44071)
0808 08:37:01.399264 (+ 11290us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:01.399270 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:01.399291 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:37:01.399354 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:01.399359 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:01.399435 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:01.399536 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:01.402777 (+ 3241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.404283 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.417883 (+ 13600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.418868 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.419011 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:01.423696 (+ 4685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:01.423705 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:01.423712 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:01.423766 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:01.428068 (+ 4302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.429315 (+ 1247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.429325 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.429331 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.429530 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.430281 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.430290 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.430296 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.430824 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:01.431203 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:01.432953 (+ 1750us) server_negotiation.cc:299] Negotiation successful
0808 08:37:01.433302 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11082}
I20260808 08:37:01.435117 20439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80ad78772b9146dab06f200037c3a434" is_pre_election: true
I20260808 08:37:01.435767 20439 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eaa8d75f88345a69f0dc22a3ffd2aba in term 0.
I20260808 08:37:01.436538 20568 leader_election.cc:302] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eaa8d75f88345a69f0dc22a3ffd2aba, 80ad78772b9146dab06f200037c3a434; no voters:
I20260808 08:37:01.437000 20635 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:37:01.437155 20635 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:37:01.437259 20635 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:01.441037 20635 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } }
I20260808 08:37:01.431185 20551 master_runner.cc:186] Error getting master registration for 127.5.164.254:35807: OK, instance_id { permanent_uuid: "80ad78772b9146dab06f200037c3a434" instance_seqno: 1786178220221893 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:37:01.443868 20551 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:37:01.443879 20439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80ad78772b9146dab06f200037c3a434"
I20260808 08:37:01.444142 20439 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:01.448310 20635 leader_election.cc:288] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [CANDIDATE]: Term 1 election: Requested vote from peers 80ad78772b9146dab06f200037c3a434 (127.5.164.254:35807), 96081244abe34904b4c137a335b0ca1c (127.5.164.253:44071)
I20260808 08:37:01.451340 20439 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eaa8d75f88345a69f0dc22a3ffd2aba in term 1.
W20260808 08:37:01.448781 20647 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:37:01.451957 20647 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:37:01.452028 20568 leader_election.cc:302] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eaa8d75f88345a69f0dc22a3ffd2aba, 80ad78772b9146dab06f200037c3a434; no voters:
I20260808 08:37:01.452452 20635 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:37:01.453756 20635 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [term 1 LEADER]: Becoming Leader. State: Replica: 3eaa8d75f88345a69f0dc22a3ffd2aba, State: Running, Role: LEADER
I20260808 08:37:01.454520 20635 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } }
W20260808 08:37:01.460870 20417 tablet.cc:2369] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:37:01.467911 20542 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } attempt: 5
I20260808 08:37:01.472612 20655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eaa8d75f88345a69f0dc22a3ffd2aba. Latest consensus state: current_term: 1 leader_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } } }
I20260808 08:37:01.474793 20655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [sys.catalog]: This master's current role is: LEADER
I20260808 08:37:01.476387 20660 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:37:01.478938 20660 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 08:37:01 dist-test-slave-chsk krb5kdc[20380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178220, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.253@KRBTEST.COM for kudu/127.5.164.252@KRBTEST.COM
I20260808 08:37:01.492977 20544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.468731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:33207 (local address 127.0.0.1:40872)
0808 08:37:01.469259 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:01.469281 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:01.469418 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:01.470570 (+ 1152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:01.470579 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:01.471375 (+ 796us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:01.471616 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:01.471636 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.473790 (+ 2154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.473798 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:01.475748 (+ 1950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:01.475766 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.477592 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.477602 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:01.477930 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:01.478841 (+ 911us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:01.478876 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:01.482783 (+ 3907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:01.488552 (+ 5769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:01.488562 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:01.488569 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:01.489451 (+ 882us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:01.490073 (+ 622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:01.490081 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:01.490088 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:01.490314 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:01.491465 (+ 1151us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:01.491473 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:01.491714 (+ 241us) client_negotiation.cc:769] Sending connection context
0808 08:37:01.491908 (+ 194us) client_negotiation.cc:240] Negotiation successful
0808 08:37:01.492375 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372}
I20260808 08:37:01.494748 20622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:01.469663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40872 (local address 127.5.164.252:33207)
0808 08:37:01.469917 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:01.469926 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:01.469955 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:37:01.470040 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:01.470049 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:01.470168 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:01.470311 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:01.471863 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.473525 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.475972 (+ 2447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:01.477116 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:01.477301 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:01.483099 (+ 5798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:01.483111 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:01.483119 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:01.483206 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:01.488256 (+ 5050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.489645 (+ 1389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.489652 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.489658 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.489890 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:01.490566 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:01.490579 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:01.490585 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:01.491086 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:01.491377 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:01.493475 (+ 2098us) server_negotiation.cc:299] Negotiation successful
0808 08:37:01.494050 (+ 575us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:37:01.500461 20542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c: Bootstrap starting.
I20260808 08:37:01.501948 20439 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434 [term 1 FOLLOWER]: Refusing update from remote peer 3eaa8d75f88345a69f0dc22a3ffd2aba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:37:01.503038 20655 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:37:01.507211 20542 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:01.509460 20542 log.cc:824] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:01.499903 20395 master_runner.cc:186] Error getting master registration for 127.5.164.253:44071: OK, instance_id { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" instance_seqno: 1786178220739729 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:37:01.513325 20395 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:37:01.529923 20641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eaa8d75f88345a69f0dc22a3ffd2aba. Latest consensus state: current_term: 1 leader_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } } }
I20260808 08:37:01.530311 20641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 08:37:01.530864 20572 tablet.cc:2369] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:37:01.534149 20663 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:37:01.534300 20663 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:37:01.537256 20635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } } }
I20260808 08:37:01.537681 20666 mvcc.cc:205] Tried to move back new op lower bound from 7316185995238711296 to 7316185995084689408. Current Snapshot: MvccSnapshot[applied={T|T < 7316185995238711296}]
I20260808 08:37:01.537813 20635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [sys.catalog]: This master's current role is: LEADER
I20260808 08:37:01.540558 20660 catalog_manager.cc:1347] Generated new cluster ID: 7bc7a330c6e14d70b00cf87e8063af4d
I20260808 08:37:01.540673 20660 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:37:01.556094 20542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c: No bootstrap required, opened a new log
I20260808 08:37:01.568708 20542 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } }
I20260808 08:37:01.569272 20542 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:01.569430 20542 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96081244abe34904b4c137a335b0ca1c, State: Initialized, Role: FOLLOWER
I20260808 08:37:01.570166 20542 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } }
I20260808 08:37:01.572911 20641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } } }
I20260808 08:37:01.573263 20641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:37:01.583854 20671 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } } }
I20260808 08:37:01.584388 20671 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:37:01.585420 20542 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:37:01.590032 20514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96081244abe34904b4c137a335b0ca1c"
I20260808 08:37:01.591241 20515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96081244abe34904b4c137a335b0ca1c" is_pre_election: true
I20260808 08:37:01.593888 20513 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:01.599555 20513 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c [term 1 FOLLOWER]: Refusing update from remote peer 3eaa8d75f88345a69f0dc22a3ffd2aba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:37:01.606424 20635 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:37:01.621042 20660 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:37:01.623020 20660 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:37:01.637734 20671 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eaa8d75f88345a69f0dc22a3ffd2aba. Latest consensus state: current_term: 1 leader_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } } }
I20260808 08:37:01.638139 20671 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:37:01.638233 20655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } } }
I20260808 08:37:01.638661 20655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba [sys.catalog]: This master's current role is: LEADER
I20260808 08:37:01.651546 20676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80ad78772b9146dab06f200037c3a434" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35807 } } peers { permanent_uuid: "96081244abe34904b4c137a335b0ca1c" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 44071 } } peers { permanent_uuid: "3eaa8d75f88345a69f0dc22a3ffd2aba" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 33207 } } }
I20260808 08:37:01.652174 20676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:37:01.668212 20660 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3eaa8d75f88345a69f0dc22a3ffd2aba: Generated new TSK 0
I20260808 08:37:01.669483 20660 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:37:01.749002 20691 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 08:37:02.536469 20663 catalog_manager.cc:1259] Loaded cluster ID: 7bc7a330c6e14d70b00cf87e8063af4d
I20260808 08:37:02.536602 20663 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434: loading cluster ID for follower catalog manager: success
I20260808 08:37:02.539006 20663 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434: acquiring CA information for follower catalog manager: success
I20260808 08:37:02.540782 20663 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 80ad78772b9146dab06f200037c3a434: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:37:02.753577 20691 catalog_manager.cc:1259] Loaded cluster ID: 7bc7a330c6e14d70b00cf87e8063af4d
I20260808 08:37:02.753691 20691 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c: loading cluster ID for follower catalog manager: success
I20260808 08:37:02.756598 20691 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c: acquiring CA information for follower catalog manager: success
I20260808 08:37:02.758390 20691 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 96081244abe34904b4c137a335b0ca1c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:37:02.836467 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 20395
I20260808 08:37:02.837801 20459 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:02.949832 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 20395
I20260808 08:37:02.984925 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 20471
I20260808 08:37:02.986214 20535 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:03.098274 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 20471
I20260808 08:37:03.120888 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 20551
I20260808 08:37:03.122068 20614 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:03.235476 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 20551
2026-08-08T08:37:03Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4911 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:37:03 dist-test-slave-chsk krb5kdc[20700](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:37:03 dist-test-slave-chsk krb5kdc[20700](info): set up 2 sockets
Aug 08 08:37:03 dist-test-slave-chsk krb5kdc[20700](info): commencing operation
krb5kdc: starting...
W20260808 08:37:04.435779 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.007s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:37:04 dist-test-slave-chsk krb5kdc[20700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178224, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:37:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:37:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:37:04.746815 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:33317
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:44157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:33317
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:37:05.098590 20714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:05.098937 20714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:05.099030 20714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:05.106655 20714 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:37:05.106796 20714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:05.106845 20714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:05.106904 20714 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:37:05.106952 20714 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:37:05.117435 20714 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:44157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:33317
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:33317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:05.118819 20714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:05.120172 20714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:05.133113 20719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:05.132998 20721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:05.133034 20723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:05.134546 20714 server_base.cc:1034] running on GCE node
I20260808 08:37:05.135568 20714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:05.137221 20714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:05.138487 20714 hybrid_clock.cc:648] HybridClock initialized: now 1786178225138441 us; error 54 us; skew 500 ppm
I20260808 08:37:05.138872 20714 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:05 dist-test-slave-chsk krb5kdc[20700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178225, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:05.142482 20714 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:37:05.144361 20714 webserver.cc:460] Webserver started at http://127.5.164.254:44125/ using document root <none> and password file <none>
I20260808 08:37:05.145146 20714 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:05.145308 20714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:05.145655 20714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:37:05.148936 20714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "9169c6eee6294f3aa4262a26d823d9ea"
format_stamp: "Formatted at 2026-08-08 08:37:05 on dist-test-slave-chsk"
server_key: "541d3a380150cdcc013e86e02c1bdcaf"
server_key_iv: "2f2a4c8082c968702b35bb6fc01df623"
server_key_version: "encryptionkey@0"
I20260808 08:37:05.149772 20714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "9169c6eee6294f3aa4262a26d823d9ea"
format_stamp: "Formatted at 2026-08-08 08:37:05 on dist-test-slave-chsk"
server_key: "541d3a380150cdcc013e86e02c1bdcaf"
server_key_iv: "2f2a4c8082c968702b35bb6fc01df623"
server_key_version: "encryptionkey@0"
I20260808 08:37:05.155565 20714 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260808 08:37:05.159474 20732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:05.160933 20714 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:37:05.161176 20714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "9169c6eee6294f3aa4262a26d823d9ea"
format_stamp: "Formatted at 2026-08-08 08:37:05 on dist-test-slave-chsk"
server_key: "541d3a380150cdcc013e86e02c1bdcaf"
server_key_iv: "2f2a4c8082c968702b35bb6fc01df623"
server_key_version: "encryptionkey@0"
I20260808 08:37:05.161423 20714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:05.202775 20714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:05.207798 20714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:05.208124 20714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:05.228909 20714 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:33317
I20260808 08:37:05.228929 20787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:33317 every 8 connection(s)
I20260808 08:37:05.230413 20714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:37:05.234386 20788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:05.238523 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 20714
I20260808 08:37:05.238788 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:37:05.239583 5779 external_mini_cluster.cc:1428] Setting key 7e3710122b7ae7e62b14acca0631f685
I20260808 08:37:05.246219 20788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea: Bootstrap starting.
I20260808 08:37:05.249603 20788 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:05.250715 20788 log.cc:824] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:05.253739 20788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea: No bootstrap required, opened a new log
Aug 08 08:37:05 dist-test-slave-chsk krb5kdc[20700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178224, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:05.263484 20788 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9169c6eee6294f3aa4262a26d823d9ea" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 33317 } }
I20260808 08:37:05.263936 20788 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:05.264062 20788 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9169c6eee6294f3aa4262a26d823d9ea, State: Initialized, Role: FOLLOWER
I20260808 08:37:05.264732 20788 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9169c6eee6294f3aa4262a26d823d9ea" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 33317 } }
I20260808 08:37:05.264987 20788 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:37:05.265034 20791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:05.241626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43124 (local address 127.5.164.254:33317)
0808 08:37:05.242473 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:05.242490 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:05.242545 (+ 55us) server_negotiation.cc:407] Connection header received
0808 08:37:05.244869 (+ 2324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:05.244895 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:05.245357 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:05.245753 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:05.247458 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:05.248821 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:05.250319 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:05.251074 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:05.251379 (+ 305us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:05.256324 (+ 4945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:05.256335 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:05.256352 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:05.256407 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:05.259983 (+ 3576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:05.260967 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:05.260974 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:05.260981 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:05.261207 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:05.261666 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:05.261669 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:05.261671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:05.262313 (+ 642us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:05.262535 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:05.263098 (+ 563us) server_negotiation.cc:299] Negotiation successful
0808 08:37:05.263596 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":351,"threads_started":1}
I20260808 08:37:05.265158 20788 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:37:05.265344 20788 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:05.268085 20788 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9169c6eee6294f3aa4262a26d823d9ea" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 33317 } }
I20260808 08:37:05.268709 20788 leader_election.cc:302] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9169c6eee6294f3aa4262a26d823d9ea; no voters:
I20260808 08:37:05.269447 20788 leader_election.cc:288] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:37:05.269532 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:37:05.269606 20793 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:37:05.271708 20788 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:37:05.274243 20793 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [term 1 LEADER]: Becoming Leader. State: Replica: 9169c6eee6294f3aa4262a26d823d9ea, State: Running, Role: LEADER
I20260808 08:37:05.274858 20793 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9169c6eee6294f3aa4262a26d823d9ea" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 33317 } }
I20260808 08:37:05.277832 20795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9169c6eee6294f3aa4262a26d823d9ea. Latest consensus state: current_term: 1 leader_uuid: "9169c6eee6294f3aa4262a26d823d9ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9169c6eee6294f3aa4262a26d823d9ea" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 33317 } } }
I20260808 08:37:05.277868 20794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9169c6eee6294f3aa4262a26d823d9ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9169c6eee6294f3aa4262a26d823d9ea" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 33317 } } }
I20260808 08:37:05.278308 20795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [sys.catalog]: This master's current role is: LEADER
I20260808 08:37:05.278308 20794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea [sys.catalog]: This master's current role is: LEADER
I20260808 08:37:05.279290 20801 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:37:05.285015 20801 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:37:05.294157 20801 catalog_manager.cc:1347] Generated new cluster ID: 83755232f460491fad6cc89fc21d210f
I20260808 08:37:05.294292 20801 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:37:05.348783 20801 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:37:05.350102 20801 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:37:05.360471 20801 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9169c6eee6294f3aa4262a26d823d9ea: Generated new TSK 0
I20260808 08:37:05.361259 20801 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:37:05.384267 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 20714
I20260808 08:37:05.385460 20782 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:05.481330 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 20714
2026-08-08T08:37:05Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2242 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:37:05 dist-test-slave-chsk krb5kdc[20816](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:37:05 dist-test-slave-chsk krb5kdc[20816](info): set up 2 sockets
Aug 08 08:37:05 dist-test-slave-chsk krb5kdc[20816](info): commencing operation
krb5kdc: starting...
W20260808 08:37:06.648106 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.002s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:37:06 dist-test-slave-chsk krb5kdc[20816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:37:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:37:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:37:06.947535 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:37351
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:37351
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:37:07.294085 20830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:07.294361 20830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:07.294574 20830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:07.301831 20830 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:37:07.301931 20830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:07.302071 20830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:07.302181 20830 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:37:07.302268 20830 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:37:07.311847 20830 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:37351
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:37351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:07.313167 20830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:07.314559 20830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:07.327082 20836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:07.327185 20837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:07.327368 20839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:07.328243 20830 server_base.cc:1034] running on GCE node
I20260808 08:37:07.329089 20830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:07.330608 20830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:07.331869 20830 hybrid_clock.cc:648] HybridClock initialized: now 1786178227331806 us; error 61 us; skew 500 ppm
I20260808 08:37:07.332262 20830 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:07 dist-test-slave-chsk krb5kdc[20816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178227, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:07.335691 20830 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:37:07.337369 20830 webserver.cc:460] Webserver started at http://127.5.164.254:41377/ using document root <none> and password file <none>
I20260808 08:37:07.338128 20830 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:07.338294 20830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:07.338644 20830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:37:07.342173 20830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "629885f48e3d4ed1bbc40ada3f467029"
format_stamp: "Formatted at 2026-08-08 08:37:07 on dist-test-slave-chsk"
server_key: "3fdd6c8af798b3ef66421615c2963c7b"
server_key_iv: "ad9b94add349421b258fb8ad5732de09"
server_key_version: "encryptionkey@0"
I20260808 08:37:07.343060 20830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "629885f48e3d4ed1bbc40ada3f467029"
format_stamp: "Formatted at 2026-08-08 08:37:07 on dist-test-slave-chsk"
server_key: "3fdd6c8af798b3ef66421615c2963c7b"
server_key_iv: "ad9b94add349421b258fb8ad5732de09"
server_key_version: "encryptionkey@0"
I20260808 08:37:07.348768 20830 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 08:37:07.352367 20848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:07.353706 20830 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:37:07.353909 20830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "629885f48e3d4ed1bbc40ada3f467029"
format_stamp: "Formatted at 2026-08-08 08:37:07 on dist-test-slave-chsk"
server_key: "3fdd6c8af798b3ef66421615c2963c7b"
server_key_iv: "ad9b94add349421b258fb8ad5732de09"
server_key_version: "encryptionkey@0"
I20260808 08:37:07.354128 20830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:07.374459 20830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:07.379082 20830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:07.379420 20830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:07.398869 20830 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:37351
I20260808 08:37:07.398932 20902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:37351 every 8 connection(s)
I20260808 08:37:07.400285 20830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:37:07.403908 20903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:07.407786 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 20830
I20260808 08:37:07.408015 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:37:07.408883 5779 external_mini_cluster.cc:1428] Setting key 15f746a0ddb299c54c683c3fe8bc1651
I20260808 08:37:07.417487 20903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: Bootstrap starting.
I20260808 08:37:07.421339 20903 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:07.422732 20903 log.cc:824] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:37:07 dist-test-slave-chsk krb5kdc[20816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:07.425776 20903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: No bootstrap required, opened a new log
I20260808 08:37:07.432709 20907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:07.411025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55132 (local address 127.5.164.254:37351)
0808 08:37:07.411799 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:07.411809 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:07.411849 (+ 40us) server_negotiation.cc:407] Connection header received
0808 08:37:07.413425 (+ 1576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:07.413445 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:07.413809 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:07.414124 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:07.415869 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:07.417257 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:07.419094 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:07.419838 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:07.419993 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:07.425335 (+ 5342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:07.425342 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:07.425355 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:07.425393 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:07.428658 (+ 3265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:07.429381 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:07.429392 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:07.429398 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:07.429564 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:07.429970 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:07.429975 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:07.429984 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:07.430476 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:07.430828 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:07.431294 (+ 466us) server_negotiation.cc:299] Negotiation successful
0808 08:37:07.431717 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":346,"threads_started":1}
I20260808 08:37:07.433813 20903 raft_consensus.cc:348] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } }
I20260808 08:37:07.434204 20903 raft_consensus.cc:374] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:07.434307 20903 raft_consensus.cc:729] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629885f48e3d4ed1bbc40ada3f467029, State: Initialized, Role: FOLLOWER
I20260808 08:37:07.434886 20903 consensus_queue.cc:260] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } }
I20260808 08:37:07.435140 20903 raft_consensus.cc:388] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:37:07.435333 20903 raft_consensus.cc:482] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:37:07.435528 20903 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:07.437762 20903 raft_consensus.cc:504] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } }
I20260808 08:37:07.438202 20903 leader_election.cc:302] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 629885f48e3d4ed1bbc40ada3f467029; no voters:
I20260808 08:37:07.438746 20903 leader_election.cc:288] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:37:07.438890 20909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:37:07.439625 20909 raft_consensus.cc:686] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 1 LEADER]: Becoming Leader. State: Replica: 629885f48e3d4ed1bbc40ada3f467029, State: Running, Role: LEADER
I20260808 08:37:07.440246 20909 consensus_queue.cc:237] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } }
I20260808 08:37:07.441056 20903 sys_catalog.cc:564] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:37:07.443181 20910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "629885f48e3d4ed1bbc40ada3f467029" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } } }
I20260808 08:37:07.443609 20910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [sys.catalog]: This master's current role is: LEADER
I20260808 08:37:07.443190 20911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 629885f48e3d4ed1bbc40ada3f467029. Latest consensus state: current_term: 1 leader_uuid: "629885f48e3d4ed1bbc40ada3f467029" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } } }
I20260808 08:37:07.443768 20911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [sys.catalog]: This master's current role is: LEADER
I20260808 08:37:07.445860 20915 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:37:07.450728 20915 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:37:07.460376 20915 catalog_manager.cc:1347] Generated new cluster ID: 57c97577c055439286d818b8c991b44d
I20260808 08:37:07.460598 20915 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:37:07.481220 20915 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:37:07.483067 20915 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:37:07.497304 20915 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: Generated new TSK 0
I20260808 08:37:07.498359 20915 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:37:07.572846 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37351
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:37:07.921242 20931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:07.921607 20931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:07.921780 20931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:07.929601 20931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:07.929772 20931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:07.929965 20931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:37:07.940573 20931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37351
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:07.942091 20931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:07.943522 20931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:07.956789 20937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:07.956858 20940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:07.956811 20938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:07.957835 20931 server_base.cc:1034] running on GCE node
I20260808 08:37:07.958487 20931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:07.959488 20931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:07.960691 20931 hybrid_clock.cc:648] HybridClock initialized: now 1786178227960644 us; error 41 us; skew 500 ppm
I20260808 08:37:07.961078 20931 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:07 dist-test-slave-chsk krb5kdc[20816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178227, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:07.964238 20931 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:37:07.965683 20931 webserver.cc:460] Webserver started at http://127.5.164.193:33551/ using document root <none> and password file <none>
I20260808 08:37:07.966361 20931 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:07.966461 20931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:07.966702 20931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:37:07.969542 20931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "6a4ed1bbddb5409d97456cb459336bcb"
format_stamp: "Formatted at 2026-08-08 08:37:07 on dist-test-slave-chsk"
server_key: "fc7633628ca87887c53d1f56ebb3d09f"
server_key_iv: "6600e12517c04e4e24ae14fa1fee85b8"
server_key_version: "encryptionkey@0"
I20260808 08:37:07.970247 20931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "6a4ed1bbddb5409d97456cb459336bcb"
format_stamp: "Formatted at 2026-08-08 08:37:07 on dist-test-slave-chsk"
server_key: "fc7633628ca87887c53d1f56ebb3d09f"
server_key_iv: "6600e12517c04e4e24ae14fa1fee85b8"
server_key_version: "encryptionkey@0"
I20260808 08:37:07.975384 20931 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 08:37:07.978885 20948 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:07.980334 20931 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:37:07.980518 20931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "6a4ed1bbddb5409d97456cb459336bcb"
format_stamp: "Formatted at 2026-08-08 08:37:07 on dist-test-slave-chsk"
server_key: "fc7633628ca87887c53d1f56ebb3d09f"
server_key_iv: "6600e12517c04e4e24ae14fa1fee85b8"
server_key_version: "encryptionkey@0"
I20260808 08:37:07.980741 20931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:07.999363 20931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:08.003953 20931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:08.004261 20931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:08.005235 20931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:37:08.006639 20931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:37:08.006744 20931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:08.006901 20931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:37:08.006976 20931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:08.040843 20931 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:36049
I20260808 08:37:08.040889 21068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:36049 every 8 connection(s)
I20260808 08:37:08.042291 20931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:37:08.049093 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 20931
I20260808 08:37:08.049319 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:37:08.050021 5779 external_mini_cluster.cc:1428] Setting key d65c1948a68252adef17357cc199fab5
Aug 08 08:37:08 dist-test-slave-chsk krb5kdc[20816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178227, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:08.064587 21071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:08.044867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:42237 (local address 127.5.164.254:37351)
0808 08:37:08.045337 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:08.045345 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:08.046308 (+ 963us) server_negotiation.cc:407] Connection header received
0808 08:37:08.048098 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:08.048103 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:08.048173 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:08.048291 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:08.050046 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:08.050981 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:08.052810 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:08.053556 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:08.053704 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:08.057399 (+ 3695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:08.057410 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:08.057417 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:08.057462 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:08.061253 (+ 3791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:08.061942 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:08.061950 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:08.061955 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:08.062153 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:08.062593 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:08.062600 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:08.062606 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:08.062980 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:08.063170 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:08.063871 (+ 701us) server_negotiation.cc:299] Negotiation successful
0808 08:37:08.064123 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":213,"threads_started":1}
I20260808 08:37:08.065294 21072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:08.045418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:42237)
0808 08:37:08.046138 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:08.046188 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:08.047844 (+ 1656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:08.048686 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:08.048694 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:08.049244 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:08.049851 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:08.049868 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:08.051197 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:08.051209 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:08.052653 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:08.052666 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:08.053791 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:08.053796 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:08.053975 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:08.054693 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:08.054720 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:08.057199 (+ 2479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:08.061401 (+ 4202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:08.061407 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:08.061418 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:08.061808 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:08.062287 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:08.062291 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:08.062294 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:08.062473 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:08.063114 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:08.063119 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:08.063487 (+ 368us) client_negotiation.cc:769] Sending connection context
0808 08:37:08.063718 (+ 231us) client_negotiation.cc:240] Negotiation successful
0808 08:37:08.064076 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":274,"threads_started":1}
I20260808 08:37:08.066757 21069 heartbeater.cc:347] Connected to a master server at 127.5.164.254:37351
I20260808 08:37:08.067088 21069 heartbeater.cc:464] Registering TS with master...
I20260808 08:37:08.067940 21069 heartbeater.cc:511] Master 127.5.164.254:37351 requested a full tablet report, sending...
I20260808 08:37:08.070124 20866 ts_manager.cc:194] Registered new tserver with Master: 6a4ed1bbddb5409d97456cb459336bcb (127.5.164.193:36049)
I20260808 08:37:08.071609 20866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:42237
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:37:08.118397 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37351
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:37:08.452709 21075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:08.453059 21075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:08.453240 21075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:08.461369 21075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:08.461535 21075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:08.461745 21075 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:37:08.471808 21075 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37351
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:08.473304 21075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:08.474717 21075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:08.488569 21081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:08.488648 21084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:08.488610 21082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:08.489444 21075 server_base.cc:1034] running on GCE node
I20260808 08:37:08.490092 21075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:08.491060 21075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:08.492336 21075 hybrid_clock.cc:648] HybridClock initialized: now 1786178228492272 us; error 51 us; skew 500 ppm
I20260808 08:37:08.492662 21075 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:08 dist-test-slave-chsk krb5kdc[20816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178228, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:08.495956 21075 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:37:08.497469 21075 webserver.cc:460] Webserver started at http://127.5.164.194:43065/ using document root <none> and password file <none>
I20260808 08:37:08.498179 21075 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:08.498330 21075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:08.498653 21075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:37:08.501786 21075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "3ac12b45831d4a70baff01c33f338144"
format_stamp: "Formatted at 2026-08-08 08:37:08 on dist-test-slave-chsk"
server_key: "6ab0c75e1248567010ff02a73fa0a54e"
server_key_iv: "2b962900b347effdba2eedc41d22506c"
server_key_version: "encryptionkey@0"
I20260808 08:37:08.502666 21075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "3ac12b45831d4a70baff01c33f338144"
format_stamp: "Formatted at 2026-08-08 08:37:08 on dist-test-slave-chsk"
server_key: "6ab0c75e1248567010ff02a73fa0a54e"
server_key_iv: "2b962900b347effdba2eedc41d22506c"
server_key_version: "encryptionkey@0"
I20260808 08:37:08.507988 21075 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 08:37:08.511605 21091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:08.512924 21075 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 08:37:08.513131 21075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "3ac12b45831d4a70baff01c33f338144"
format_stamp: "Formatted at 2026-08-08 08:37:08 on dist-test-slave-chsk"
server_key: "6ab0c75e1248567010ff02a73fa0a54e"
server_key_iv: "2b962900b347effdba2eedc41d22506c"
server_key_version: "encryptionkey@0"
I20260808 08:37:08.513335 21075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:08.531343 21075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:08.535773 21075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:08.536083 21075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:08.537115 21075 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:37:08.538511 21075 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:37:08.538621 21075 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:08.538790 21075 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:37:08.538866 21075 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:08.576241 21075 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:38967
I20260808 08:37:08.576284 21211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:38967 every 8 connection(s)
I20260808 08:37:08.577559 21075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:37:08.586293 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 21075
I20260808 08:37:08.586539 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:37:08.587049 5779 external_mini_cluster.cc:1428] Setting key 409aed7438627c5a3ad5288d158a8f64
Aug 08 08:37:08 dist-test-slave-chsk krb5kdc[20816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178228, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:08.598928 21214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:08.580163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:53591 (local address 127.5.164.254:37351)
0808 08:37:08.580644 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:08.580648 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:08.581466 (+ 818us) server_negotiation.cc:407] Connection header received
0808 08:37:08.583328 (+ 1862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:08.583333 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:08.583423 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:08.583545 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:08.585031 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:08.585776 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:08.587504 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:08.588115 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:08.588262 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:08.592639 (+ 4377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:08.592644 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:08.592648 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:08.592681 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:08.595362 (+ 2681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:08.596436 (+ 1074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:08.596439 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:08.596442 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:08.596566 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:08.597101 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:08.597104 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:08.597106 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:08.597375 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:08.597485 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:08.598487 (+ 1002us) server_negotiation.cc:299] Negotiation successful
0808 08:37:08.598656 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":271,"threads_started":1}
I20260808 08:37:08.600700 21216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:08.580632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:53591)
0808 08:37:08.581314 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:08.581351 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:08.583001 (+ 1650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:08.583796 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:08.583804 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:08.584304 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:08.584853 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:08.584870 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:08.585964 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:08.585969 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:08.587361 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:08.587374 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:08.588352 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:08.588362 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:08.588602 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:08.589323 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:08.589361 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:08.592402 (+ 3041us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:08.595517 (+ 3115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:08.595530 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:08.595550 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:08.596303 (+ 753us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:08.596683 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:08.596692 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:08.596699 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:08.596972 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:08.597512 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:08.597524 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:08.598060 (+ 536us) client_negotiation.cc:769] Sending connection context
0808 08:37:08.598408 (+ 348us) client_negotiation.cc:240] Negotiation successful
0808 08:37:08.599051 (+ 643us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":266,"threads_started":1}
I20260808 08:37:08.602332 21212 heartbeater.cc:347] Connected to a master server at 127.5.164.254:37351
I20260808 08:37:08.602654 21212 heartbeater.cc:464] Registering TS with master...
I20260808 08:37:08.603654 21212 heartbeater.cc:511] Master 127.5.164.254:37351 requested a full tablet report, sending...
I20260808 08:37:08.605443 20866 ts_manager.cc:194] Registered new tserver with Master: 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967)
I20260808 08:37:08.606328 20866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:53591
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:37:08.655361 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37351
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:37:08.988463 21219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:08.988806 21219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:08.988988 21219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:08.996169 21219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:08.996327 21219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:08.996513 21219 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:37:09.006299 21219 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37351
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:09.007706 21219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:09.009120 21219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:09.022365 21225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:09.022279 21226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:09.022406 21228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:09.023265 21219 server_base.cc:1034] running on GCE node
I20260808 08:37:09.023947 21219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:09.024853 21219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:09.026078 21219 hybrid_clock.cc:648] HybridClock initialized: now 1786178229026025 us; error 63 us; skew 500 ppm
I20260808 08:37:09.026391 21219 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:09 dist-test-slave-chsk krb5kdc[20816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178229, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:09.029512 21219 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:37:09.031028 21219 webserver.cc:460] Webserver started at http://127.5.164.195:41027/ using document root <none> and password file <none>
I20260808 08:37:09.031755 21219 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:09.031903 21219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:09.032202 21219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:37:09.035077 21219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "267fe901cac445a2b2de1301232cbd0b"
format_stamp: "Formatted at 2026-08-08 08:37:09 on dist-test-slave-chsk"
server_key: "b845c051ec406b81cdfafb1990f5057f"
server_key_iv: "37664ad9d9ef60e3bc6a3236a1f20adc"
server_key_version: "encryptionkey@0"
I20260808 08:37:09.035989 21219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "267fe901cac445a2b2de1301232cbd0b"
format_stamp: "Formatted at 2026-08-08 08:37:09 on dist-test-slave-chsk"
server_key: "b845c051ec406b81cdfafb1990f5057f"
server_key_iv: "37664ad9d9ef60e3bc6a3236a1f20adc"
server_key_version: "encryptionkey@0"
I20260808 08:37:09.041404 21219 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:37:09.045882 21235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:09.047434 21219 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:37:09.047616 21219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "267fe901cac445a2b2de1301232cbd0b"
format_stamp: "Formatted at 2026-08-08 08:37:09 on dist-test-slave-chsk"
server_key: "b845c051ec406b81cdfafb1990f5057f"
server_key_iv: "37664ad9d9ef60e3bc6a3236a1f20adc"
server_key_version: "encryptionkey@0"
I20260808 08:37:09.047804 21219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:09.067683 21219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:09.071727 21219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:09.072036 21219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:09.073043 21219 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:37:09.074440 21219 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:37:09.074515 21219 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:09.074710 21219 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:37:09.074808 21219 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:09.075302 21069 heartbeater.cc:503] Master 127.5.164.254:37351 was elected leader, sending a full tablet report...
I20260808 08:37:09.110194 21219 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:41819
I20260808 08:37:09.110244 21356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:41819 every 8 connection(s)
I20260808 08:37:09.111553 21219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:37:09.116150 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 21219
I20260808 08:37:09.116339 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:37:09.116876 5779 external_mini_cluster.cc:1428] Setting key 926fea7bc66a41abe7d0d133badf2f55
Aug 08 08:37:09 dist-test-slave-chsk krb5kdc[20816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178229, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:09.132417 21360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.114162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:41623 (local address 127.5.164.254:37351)
0808 08:37:09.114654 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:09.114666 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:09.115603 (+ 937us) server_negotiation.cc:407] Connection header received
0808 08:37:09.117820 (+ 2217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:09.117825 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:09.117915 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:09.118063 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:09.119824 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.120611 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.122184 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.122602 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.122738 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.126412 (+ 3674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:09.126416 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:09.126420 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:09.126454 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:09.129157 (+ 2703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:09.129906 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:09.129918 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:09.129921 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:09.130046 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:09.130489 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:09.130493 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:09.130495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:09.130792 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:09.130970 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:09.131724 (+ 754us) server_negotiation.cc:299] Negotiation successful
0808 08:37:09.131951 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":247,"threads_started":1}
I20260808 08:37:09.133406 21361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.114576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:41623)
0808 08:37:09.115423 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:09.115469 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:09.117491 (+ 2022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:09.118335 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:09.118347 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:09.119016 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:09.119658 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:09.119675 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.120756 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.120761 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:09.122040 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:09.122053 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.122844 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.122851 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:09.123088 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.123775 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:09.123802 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:09.126183 (+ 2381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:09.129303 (+ 3120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:09.129312 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:09.129329 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:09.129771 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:09.130158 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:09.130163 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:09.130167 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:09.130359 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:09.130928 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:09.130936 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:09.131360 (+ 424us) client_negotiation.cc:769] Sending connection context
0808 08:37:09.131625 (+ 265us) client_negotiation.cc:240] Negotiation successful
0808 08:37:09.132187 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"thread_start_us":350,"threads_started":1}
I20260808 08:37:09.134912 21358 heartbeater.cc:347] Connected to a master server at 127.5.164.254:37351
I20260808 08:37:09.135310 21358 heartbeater.cc:464] Registering TS with master...
I20260808 08:37:09.136076 21358 heartbeater.cc:511] Master 127.5.164.254:37351 requested a full tablet report, sending...
I20260808 08:37:09.137524 20866 ts_manager.cc:194] Registered new tserver with Master: 267fe901cac445a2b2de1301232cbd0b (127.5.164.195:41819)
I20260808 08:37:09.138353 20866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:41623
I20260808 08:37:09.144896 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:37:09.162873 21360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.149601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55148 (local address 127.5.164.254:37351)
0808 08:37:09.149774 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:09.149778 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:09.150177 (+ 399us) server_negotiation.cc:407] Connection header received
0808 08:37:09.150341 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:09.150344 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:09.150410 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:09.150500 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:09.152340 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.153231 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.154635 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.155064 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.155247 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.157798 (+ 2551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:09.157806 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:09.157812 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:09.157853 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:09.160537 (+ 2684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:09.161165 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:09.161168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:09.161171 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:09.161282 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:09.161593 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:09.161596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:09.161598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:09.161906 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:09.162094 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:09.162449 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 08:37:09.162634 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:37:09.167197 20866 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55148:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:37:09.174333 20866 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:37:09.200752 21372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.187279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:38967 (local address 127.0.0.1:49830)
0808 08:37:09.187998 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:09.188060 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:09.188226 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:09.192355 (+ 4129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:09.192362 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:09.192394 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:09.192864 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:09.192881 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.195053 (+ 2172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.195060 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:09.197812 (+ 2752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:09.197831 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.199613 (+ 1782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.199619 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:09.199811 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.199878 (+ 67us) client_negotiation.cc:769] Sending connection context
0808 08:37:09.199994 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 08:37:09.200194 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"mutex_wait_us":40,"thread_start_us":738,"threads_started":1}
I20260808 08:37:09.201293 21374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.187429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58838 (local address 127.5.164.193:36049)
0808 08:37:09.193236 (+ 5807us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:09.193245 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:09.193272 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:37:09.193367 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:09.193374 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:09.193619 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:09.193820 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:09.194542 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.196100 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.198410 (+ 2310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.199783 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.199922 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.200170 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:09.200764 (+ 594us) server_negotiation.cc:299] Negotiation successful
0808 08:37:09.200950 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5626,"thread_start_us":5470,"threads_started":1}
I20260808 08:37:09.201304 21373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.187291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:36049 (local address 127.0.0.1:58838)
0808 08:37:09.189182 (+ 1891us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:09.189199 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:09.189307 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:09.193833 (+ 4526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:09.193837 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:09.193864 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:09.194345 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:09.194365 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.196255 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.196260 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:09.198227 (+ 1967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:09.198243 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.200340 (+ 2097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.200349 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:09.200533 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.200591 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 08:37:09.200710 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 08:37:09.200860 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1749,"mutex_wait_us":78,"thread_start_us":1561,"threads_started":1}
I20260808 08:37:09.201745 21376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.189426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:41819 (local address 127.0.0.1:54398)
0808 08:37:09.190048 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:09.190082 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:09.190216 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:09.194216 (+ 4000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:09.194221 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:09.194247 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:09.194669 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:09.194679 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.196569 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.196575 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:09.198740 (+ 2165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:09.198754 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.200865 (+ 2111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.200871 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:09.201069 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.201105 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:37:09.201204 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 08:37:09.201353 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":44,"thread_start_us":869,"threads_started":1}
I20260808 08:37:09.202430 21375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.187788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49830 (local address 127.5.164.194:38967)
0808 08:37:09.191640 (+ 3852us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:09.191649 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:09.191678 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:37:09.191780 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:09.191787 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:09.192090 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:09.193115 (+ 1025us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:09.193349 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.194929 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.198007 (+ 3078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.199366 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.201585 (+ 2219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.201811 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:09.201887 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 08:37:09.202090 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3701,"thread_start_us":3556,"threads_started":1}
I20260808 08:37:09.202499 21377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.189948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54398 (local address 127.5.164.195:41819)
0808 08:37:09.193647 (+ 3699us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:09.193652 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:09.193679 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:37:09.193776 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:09.193784 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:09.193997 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:09.194207 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:09.194867 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.196416 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.198910 (+ 2494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.200356 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.200481 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.200707 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:09.201963 (+ 1256us) server_negotiation.cc:299] Negotiation successful
0808 08:37:09.202151 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3557,"thread_start_us":3359,"threads_started":1}
I20260808 08:37:09.205614 20999 tablet_service.cc:1467] Processing CreateTablet for tablet 9ba22740ed2b46e4af51c802593f5b79 (DEFAULT_TABLE table=test-table [id=4bc5cf9fa363434293755626c809ee0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:37:09.205931 21141 tablet_service.cc:1467] Processing CreateTablet for tablet 9ba22740ed2b46e4af51c802593f5b79 (DEFAULT_TABLE table=test-table [id=4bc5cf9fa363434293755626c809ee0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:37:09.207039 20999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ba22740ed2b46e4af51c802593f5b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:09.206600 21288 tablet_service.cc:1467] Processing CreateTablet for tablet 9ba22740ed2b46e4af51c802593f5b79 (DEFAULT_TABLE table=test-table [id=4bc5cf9fa363434293755626c809ee0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:37:09.207345 21141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ba22740ed2b46e4af51c802593f5b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:09.207971 21288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ba22740ed2b46e4af51c802593f5b79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:09.220525 21378 tablet_bootstrap.cc:492] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb: Bootstrap starting.
I20260808 08:37:09.223920 21380 tablet_bootstrap.cc:492] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b: Bootstrap starting.
I20260808 08:37:09.224304 21378 tablet_bootstrap.cc:654] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:09.225777 21379 tablet_bootstrap.cc:492] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144: Bootstrap starting.
I20260808 08:37:09.225818 21378 log.cc:824] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:09.227833 21380 tablet_bootstrap.cc:654] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:09.229003 21379 tablet_bootstrap.cc:654] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:09.229461 21380 log.cc:824] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:09.230047 21379 log.cc:824] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:09.233054 21380 tablet_bootstrap.cc:492] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b: No bootstrap required, opened a new log
I20260808 08:37:09.233357 21380 ts_tablet_manager.cc:1397] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 08:37:09.233531 21378 tablet_bootstrap.cc:492] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb: No bootstrap required, opened a new log
I20260808 08:37:09.233546 21379 tablet_bootstrap.cc:492] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144: No bootstrap required, opened a new log
I20260808 08:37:09.233803 21378 ts_tablet_manager.cc:1397] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.004s
I20260808 08:37:09.233814 21379 ts_tablet_manager.cc:1397] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260808 08:37:09.241485 21379 raft_consensus.cc:348] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } } peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } }
I20260808 08:37:09.241894 21379 raft_consensus.cc:374] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:09.242050 21379 raft_consensus.cc:729] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ac12b45831d4a70baff01c33f338144, State: Initialized, Role: FOLLOWER
I20260808 08:37:09.242753 21379 consensus_queue.cc:260] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } } peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } }
I20260808 08:37:09.243920 21212 heartbeater.cc:503] Master 127.5.164.254:37351 was elected leader, sending a full tablet report...
I20260808 08:37:09.244418 21380 raft_consensus.cc:348] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } } peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } }
I20260808 08:37:09.244516 21378 raft_consensus.cc:348] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } } peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } }
I20260808 08:37:09.244869 21380 raft_consensus.cc:374] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:09.244881 21378 raft_consensus.cc:374] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:09.244975 21378 raft_consensus.cc:729] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a4ed1bbddb5409d97456cb459336bcb, State: Initialized, Role: FOLLOWER
I20260808 08:37:09.245054 21380 raft_consensus.cc:729] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 267fe901cac445a2b2de1301232cbd0b, State: Initialized, Role: FOLLOWER
I20260808 08:37:09.245882 21379 ts_tablet_manager.cc:1428] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144: Time spent starting tablet: real 0.012s user 0.010s sys 0.001s
I20260808 08:37:09.245766 21378 consensus_queue.cc:260] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } } peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } }
I20260808 08:37:09.245765 21380 consensus_queue.cc:260] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } } peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } }
I20260808 08:37:09.246989 21358 heartbeater.cc:503] Master 127.5.164.254:37351 was elected leader, sending a full tablet report...
I20260808 08:37:09.247879 21380 ts_tablet_manager.cc:1428] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260808 08:37:09.251070 21378 ts_tablet_manager.cc:1428] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb: Time spent starting tablet: real 0.017s user 0.017s sys 0.000s
W20260808 08:37:09.294847 21070 tablet.cc:2369] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:37:09.329680 21213 tablet.cc:2369] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:37:09.363265 21359 tablet.cc:2369] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:37:09.523754 21386 raft_consensus.cc:482] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:37:09.524128 21386 raft_consensus.cc:504] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } } peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } }
I20260808 08:37:09.525905 21386 leader_election.cc:288] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a4ed1bbddb5409d97456cb459336bcb (127.5.164.193:36049), 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967)
I20260808 08:37:09.529709 21384 raft_consensus.cc:482] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:37:09.530004 21384 raft_consensus.cc:504] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } } peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } }
I20260808 08:37:09.532163 21375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.526391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:37253 (local address 127.5.164.194:38967)
0808 08:37:09.526609 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:09.526616 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:09.526749 (+ 133us) server_negotiation.cc:407] Connection header received
0808 08:37:09.526985 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:09.526998 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:09.527069 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:09.527205 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:09.527601 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.528333 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.530202 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.531110 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.531368 (+ 258us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.531442 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:09.531757 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 08:37:09.531887 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:37:09.532178 21361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.526291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:38967 (local address 127.5.164.195:37253)
0808 08:37:09.526634 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:09.526655 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:09.526834 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:09.527215 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:09.527220 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:09.527256 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:09.527460 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:09.527468 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.528478 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.528483 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:09.530028 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:09.530044 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.531355 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.531364 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:09.531579 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.531610 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 08:37:09.531722 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 08:37:09.531861 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":22}
I20260808 08:37:09.533432 21162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ba22740ed2b46e4af51c802593f5b79" candidate_uuid: "267fe901cac445a2b2de1301232cbd0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ac12b45831d4a70baff01c33f338144" is_pre_election: true
I20260808 08:37:09.533808 21384 leader_election.cc:288] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a4ed1bbddb5409d97456cb459336bcb (127.5.164.193:36049), 267fe901cac445a2b2de1301232cbd0b (127.5.164.195:41819)
I20260808 08:37:09.533982 21162 raft_consensus.cc:2454] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 267fe901cac445a2b2de1301232cbd0b in term 0.
I20260808 08:37:09.534183 21374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.526395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:48023 (local address 127.5.164.193:36049)
0808 08:37:09.526645 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:09.526654 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:09.527522 (+ 868us) server_negotiation.cc:407] Connection header received
0808 08:37:09.527734 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:09.527738 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:09.527797 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:09.527889 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:09.528438 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.529126 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.531612 (+ 2486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.532942 (+ 1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.533121 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.533203 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:09.533730 (+ 527us) server_negotiation.cc:299] Negotiation successful
0808 08:37:09.533879 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 08:37:09.534842 21240 leader_election.cc:302] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 267fe901cac445a2b2de1301232cbd0b, 3ac12b45831d4a70baff01c33f338144; no voters:
I20260808 08:37:09.535012 21387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.526561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:36049 (local address 127.5.164.195:48023)
0808 08:37:09.527399 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:09.527417 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:09.527576 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:09.527917 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:09.527921 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:09.527947 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:09.528268 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:09.528276 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.529273 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.529278 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:09.531365 (+ 2087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:09.531380 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.533334 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.533342 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:09.533532 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.533576 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 08:37:09.534331 (+ 755us) client_negotiation.cc:240] Negotiation successful
0808 08:37:09.534549 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"mutex_wait_us":1,"thread_start_us":458,"threads_started":1}
I20260808 08:37:09.535312 21386 raft_consensus.cc:2781] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:37:09.535475 21386 raft_consensus.cc:482] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:37:09.535602 21386 raft_consensus.cc:3037] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:09.536170 21021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ba22740ed2b46e4af51c802593f5b79" candidate_uuid: "267fe901cac445a2b2de1301232cbd0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a4ed1bbddb5409d97456cb459336bcb" is_pre_election: true
I20260808 08:37:09.536862 21021 raft_consensus.cc:2454] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 267fe901cac445a2b2de1301232cbd0b in term 0.
I20260808 08:37:09.538933 21386 raft_consensus.cc:504] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } } peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } }
I20260808 08:37:09.539815 21386 leader_election.cc:288] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [CANDIDATE]: Term 1 election: Requested vote from peers 6a4ed1bbddb5409d97456cb459336bcb (127.5.164.193:36049), 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967)
I20260808 08:37:09.540215 21021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ba22740ed2b46e4af51c802593f5b79" candidate_uuid: "267fe901cac445a2b2de1301232cbd0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a4ed1bbddb5409d97456cb459336bcb"
I20260808 08:37:09.540300 21162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ba22740ed2b46e4af51c802593f5b79" candidate_uuid: "267fe901cac445a2b2de1301232cbd0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ac12b45831d4a70baff01c33f338144"
I20260808 08:37:09.540442 21021 raft_consensus.cc:3037] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:09.540518 21162 raft_consensus.cc:3037] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:09.542634 21388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.532442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:36049 (local address 127.5.164.194:34061)
0808 08:37:09.533308 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:09.533333 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:09.533452 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:09.534816 (+ 1364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:09.534822 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:09.534853 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:09.535281 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:09.535297 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.537276 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.537282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:09.539625 (+ 2343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:09.539642 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.541611 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.541618 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:09.541829 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.541870 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 08:37:09.541953 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 08:37:09.542155 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":710,"thread_start_us":647,"threads_started":1}
I20260808 08:37:09.543591 21389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.532909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:34061 (local address 127.5.164.193:36049)
0808 08:37:09.534496 (+ 1587us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:09.534502 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:09.534523 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:37:09.534577 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:09.534582 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:09.534654 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:09.535442 (+ 788us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:09.535785 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.537108 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.539842 (+ 2734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.541354 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.542952 (+ 1598us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.543054 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:09.543106 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 08:37:09.543264 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1450,"thread_start_us":1629,"threads_started":1}
I20260808 08:37:09.543939 21021 raft_consensus.cc:2454] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 267fe901cac445a2b2de1301232cbd0b in term 1.
I20260808 08:37:09.544255 21162 raft_consensus.cc:2454] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 267fe901cac445a2b2de1301232cbd0b in term 1.
I20260808 08:37:09.544473 21239 leader_election.cc:302] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 267fe901cac445a2b2de1301232cbd0b, 6a4ed1bbddb5409d97456cb459336bcb; no voters:
I20260808 08:37:09.544837 21386 raft_consensus.cc:2781] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:37:09.544744 21020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ba22740ed2b46e4af51c802593f5b79" candidate_uuid: "3ac12b45831d4a70baff01c33f338144" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a4ed1bbddb5409d97456cb459336bcb" is_pre_election: true
I20260808 08:37:09.545203 21020 raft_consensus.cc:2379] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ac12b45831d4a70baff01c33f338144 in current term 1: Already voted for candidate 267fe901cac445a2b2de1301232cbd0b in this term.
I20260808 08:37:09.546229 21386 raft_consensus.cc:686] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [term 1 LEADER]: Becoming Leader. State: Replica: 267fe901cac445a2b2de1301232cbd0b, State: Running, Role: LEADER
I20260808 08:37:09.547081 21377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.534360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:44377 (local address 127.5.164.195:41819)
0808 08:37:09.534555 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:09.534560 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:09.538997 (+ 4437us) server_negotiation.cc:407] Connection header received
0808 08:37:09.539210 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:09.539218 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:09.539295 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:09.539407 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:09.540491 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.541576 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.544217 (+ 2641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.545571 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.546252 (+ 681us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.546341 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:09.546653 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 08:37:09.546815 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:37:09.547091 21390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.534022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:41819 (local address 127.5.164.194:44377)
0808 08:37:09.538897 (+ 4875us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:09.538911 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:09.539060 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:09.539435 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:09.539439 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:09.539465 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:09.540293 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:09.540306 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.541795 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.541802 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:09.544028 (+ 2226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:09.544047 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.546278 (+ 2231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.546283 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:09.546464 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.546497 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 08:37:09.546612 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 08:37:09.546741 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4747,"thread_start_us":4554,"threads_started":1}
I20260808 08:37:09.546850 21386 consensus_queue.cc:237] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } } peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } }
I20260808 08:37:09.547976 21309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ba22740ed2b46e4af51c802593f5b79" candidate_uuid: "3ac12b45831d4a70baff01c33f338144" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "267fe901cac445a2b2de1301232cbd0b" is_pre_election: true
I20260808 08:37:09.548789 21094 leader_election.cc:302] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ac12b45831d4a70baff01c33f338144; no voters: 267fe901cac445a2b2de1301232cbd0b, 6a4ed1bbddb5409d97456cb459336bcb
I20260808 08:37:09.549203 21384 raft_consensus.cc:2726] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 08:37:09.552102 20864 catalog_manager.cc:5495] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 267fe901cac445a2b2de1301232cbd0b (127.5.164.195). New cstate: current_term: 1 leader_uuid: "267fe901cac445a2b2de1301232cbd0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } health_report { overall_health: HEALTHY } } }
I20260808 08:37:09.656328 21377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.650446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54408 (local address 127.5.164.195:41819)
0808 08:37:09.650665 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:09.650673 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:09.650753 (+ 80us) server_negotiation.cc:407] Connection header received
0808 08:37:09.651027 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:09.651033 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:09.651203 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:09.651387 (+ 184us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:37:09.651881 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.652636 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.654023 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.654433 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.654580 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.655104 (+ 524us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:37:09.655688 (+ 584us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:37:09.655845 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:09.655925 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 08:37:09.656009 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 08:37:09.664562 21162 raft_consensus.cc:1261] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144 [term 1 FOLLOWER]: Refusing update from remote peer 267fe901cac445a2b2de1301232cbd0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:37:09.664544 21020 raft_consensus.cc:1261] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Refusing update from remote peer 267fe901cac445a2b2de1301232cbd0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:37:09.665508 21391 consensus_queue.cc:1035] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:37:09.665854 21386 consensus_queue.cc:1035] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:37:09.693284 20865 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:37:09.693602 20865 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:37:09.697270 20865 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: Sending DeleteTablet for 3 replicas of tablet 9ba22740ed2b46e4af51c802593f5b79
I20260808 08:37:09.698542 21141 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ba22740ed2b46e4af51c802593f5b79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:37:09 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:49830
I20260808 08:37:09.698576 20999 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ba22740ed2b46e4af51c802593f5b79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:37:09 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:58838
I20260808 08:37:09.698762 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 20931
I20260808 08:37:09.699627 21288 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ba22740ed2b46e4af51c802593f5b79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:37:09 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:54398
I20260808 08:37:09.711006 21403 tablet_replica.cc:330] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144: stopping tablet replica
I20260808 08:37:09.711273 21404 tablet_replica.cc:330] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb: stopping tablet replica
I20260808 08:37:09.711867 21404 raft_consensus.cc:2229] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:37:09.712478 21404 raft_consensus.cc:2258] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:37:09.712567 21403 raft_consensus.cc:2229] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:37:09.713891 21403 raft_consensus.cc:2258] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:37:09.715073 21404 ts_tablet_manager.cc:1905] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:37:09.717566 21403 ts_tablet_manager.cc:1905] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:37:09.722697 21404 ts_tablet_manager.cc:1918] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:37:09.722940 21404 log.cc:1196] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/9ba22740ed2b46e4af51c802593f5b79
I20260808 08:37:09.723567 21404 ts_tablet_manager.cc:1939] T 9ba22740ed2b46e4af51c802593f5b79 P 6a4ed1bbddb5409d97456cb459336bcb: Deleting consensus metadata
I20260808 08:37:09.723698 21406 tablet_replica.cc:330] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b: stopping tablet replica
I20260808 08:37:09.724267 21406 raft_consensus.cc:2229] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:37:09.725682 20851 catalog_manager.cc:4841] TS 6a4ed1bbddb5409d97456cb459336bcb (127.5.164.193:36049): tablet 9ba22740ed2b46e4af51c802593f5b79 (table test-table [id=4bc5cf9fa363434293755626c809ee0b]) successfully deleted
I20260808 08:37:09.726761 21406 raft_consensus.cc:2258] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 08 08:37:09 dist-test-slave-chsk krb5kdc[20816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:37:09.726905 21403 ts_tablet_manager.cc:1918] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:37:09.727097 21403 log.cc:1196] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/9ba22740ed2b46e4af51c802593f5b79
I20260808 08:37:09.727731 21403 ts_tablet_manager.cc:1939] T 9ba22740ed2b46e4af51c802593f5b79 P 3ac12b45831d4a70baff01c33f338144: Deleting consensus metadata
I20260808 08:37:09.729918 21406 ts_tablet_manager.cc:1905] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:37:09.733314 20852 catalog_manager.cc:4841] TS 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967): tablet 9ba22740ed2b46e4af51c802593f5b79 (table test-table [id=4bc5cf9fa363434293755626c809ee0b]) successfully deleted
I20260808 08:37:09.737648 21406 ts_tablet_manager.cc:1918] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:37:09.737906 21406 log.cc:1196] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/9ba22740ed2b46e4af51c802593f5b79
I20260808 08:37:09.738517 21406 ts_tablet_manager.cc:1939] T 9ba22740ed2b46e4af51c802593f5b79 P 267fe901cac445a2b2de1301232cbd0b: Deleting consensus metadata
I20260808 08:37:09.740463 20851 catalog_manager.cc:4841] TS 267fe901cac445a2b2de1301232cbd0b (127.5.164.195:41819): tablet 9ba22740ed2b46e4af51c802593f5b79 (table test-table [id=4bc5cf9fa363434293755626c809ee0b]) successfully deleted
I20260808 08:37:09.742261 21389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.700020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58854 (local address 127.5.164.193:36049)
0808 08:37:09.700246 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:09.700255 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:09.714667 (+ 14412us) server_negotiation.cc:407] Connection header received
0808 08:37:09.715077 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:09.715086 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:09.715230 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:09.715366 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:09.717827 (+ 2461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.718956 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.721231 (+ 2275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.721912 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.722051 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.734233 (+ 12182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:09.734255 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:09.734274 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:09.734321 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:09.738731 (+ 4410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:09.739798 (+ 1067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:09.739805 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:09.739808 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:09.739954 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:09.740460 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:09.740472 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:09.740475 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:09.740917 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:09.741275 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:09.741616 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 08:37:09.741874 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:37:09.743021 21064 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:09.836256 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 20931
I20260808 08:37:09.858170 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 21075
Aug 08 08:37:09 dist-test-slave-chsk krb5kdc[20816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:37:09.874521 21375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.859100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49836 (local address 127.5.164.194:38967)
0808 08:37:09.859299 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:09.859306 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:09.859351 (+ 45us) server_negotiation.cc:407] Connection header received
0808 08:37:09.859582 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:09.859588 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:09.859673 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:09.859784 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:09.861089 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.861800 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.863186 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.863594 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.863737 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:09.868388 (+ 4651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:09.868404 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:09.868419 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:09.868456 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:09.871653 (+ 3197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:09.872517 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:09.872524 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:09.872526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:09.872669 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:09.873071 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:09.873074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:09.873076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:09.873431 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:09.873666 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:09.874026 (+ 360us) server_negotiation.cc:299] Negotiation successful
0808 08:37:09.874199 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260808 08:37:09.875381 21206 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:09.969678 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 21075
I20260808 08:37:09.990546 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 21219
Aug 08 08:37:09 dist-test-slave-chsk krb5kdc[20816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:37:10.009533 21377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:09.991408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54422 (local address 127.5.164.195:41819)
0808 08:37:09.991633 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:09.991638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:09.991826 (+ 188us) server_negotiation.cc:407] Connection header received
0808 08:37:09.991974 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:09.991980 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:09.992076 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:09.992204 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:09.993529 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.994694 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.996158 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:09.996898 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:09.997055 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:10.001783 (+ 4728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:10.001809 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:10.001833 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:10.001888 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:10.006144 (+ 4256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:10.006945 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:10.006956 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:10.006962 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:10.007127 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:10.007636 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:10.007642 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:10.007646 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:10.008252 (+ 606us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:10.008618 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:10.008885 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 08:37:10.009140 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:37:10.010370 21352 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:10.137310 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 21219
I20260808 08:37:10.162842 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 20830
I20260808 08:37:10.164155 20898 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:10.277467 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 20830
I20260808 08:37:10.304390 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:37351
--webserver_interface=127.5.164.254
--webserver_port=41377
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:37351
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:37:10.663785 21411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:10.664140 21411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:10.664319 21411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:10.671640 21411 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:37:10.671810 21411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:10.671926 21411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:10.672035 21411 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:37:10.672127 21411 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:37:10.682132 21411 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:37351
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:37351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=41377
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:10.683672 21411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:10.685027 21411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:10.714164 21421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:10.714128 21419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:10.714916 21418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:10.715412 21411 server_base.cc:1034] running on GCE node
I20260808 08:37:10.716382 21411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:10.718051 21411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:10.719251 21411 hybrid_clock.cc:648] HybridClock initialized: now 1786178230719196 us; error 39 us; skew 500 ppm
I20260808 08:37:10.719691 21411 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:10 dist-test-slave-chsk krb5kdc[20816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178230, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:10.730057 21411 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:37:10.732066 21411 webserver.cc:460] Webserver started at http://127.5.164.254:41377/ using document root <none> and password file <none>
I20260808 08:37:10.732945 21411 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:10.733112 21411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:10.739876 21411 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:37:10.743108 21430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:10.744793 21411 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:37:10.745005 21411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "629885f48e3d4ed1bbc40ada3f467029"
format_stamp: "Formatted at 2026-08-08 08:37:07 on dist-test-slave-chsk"
server_key: "3fdd6c8af798b3ef66421615c2963c7b"
server_key_iv: "ad9b94add349421b258fb8ad5732de09"
server_key_version: "encryptionkey@0"
I20260808 08:37:10.746220 21411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:10.761229 21411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:10.765841 21411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:10.766147 21411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:10.786903 21411 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:37351
I20260808 08:37:10.786935 21483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:37351 every 8 connection(s)
I20260808 08:37:10.788576 21411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:37:10.795753 21484 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:37:10.795799 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 21411
I20260808 08:37:10.796645 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:36049
--local_ip_for_outbound_sockets=127.5.164.193
--tserver_master_addrs=127.5.164.254:37351
--webserver_port=33551
--webserver_interface=127.5.164.193
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:37:10.799392 21484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: Bootstrap starting.
I20260808 08:37:10.819957 21484 log.cc:824] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:10.832525 21484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:37:10.833115 21484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: Bootstrap complete.
I20260808 08:37:10.842723 21484 raft_consensus.cc:348] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } }
I20260808 08:37:10.843786 21484 raft_consensus.cc:729] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629885f48e3d4ed1bbc40ada3f467029, State: Initialized, Role: FOLLOWER
I20260808 08:37:10.844485 21484 consensus_queue.cc:260] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } }
I20260808 08:37:10.844755 21484 raft_consensus.cc:388] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:37:10.844901 21484 raft_consensus.cc:482] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:37:10.845093 21484 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:37:10.849371 21484 raft_consensus.cc:504] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } }
I20260808 08:37:10.849978 21484 leader_election.cc:302] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 629885f48e3d4ed1bbc40ada3f467029; no voters:
I20260808 08:37:10.850709 21484 leader_election.cc:288] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 08:37:10.850950 21488 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:37:10.852949 21484 sys_catalog.cc:564] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:37:10.858206 21488 raft_consensus.cc:686] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 2 LEADER]: Becoming Leader. State: Replica: 629885f48e3d4ed1bbc40ada3f467029, State: Running, Role: LEADER
I20260808 08:37:10.858984 21488 consensus_queue.cc:237] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } }
I20260808 08:37:10.864962 21490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 629885f48e3d4ed1bbc40ada3f467029. Latest consensus state: current_term: 2 leader_uuid: "629885f48e3d4ed1bbc40ada3f467029" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } } }
I20260808 08:37:10.865398 21490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [sys.catalog]: This master's current role is: LEADER
I20260808 08:37:10.866034 21489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "629885f48e3d4ed1bbc40ada3f467029" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } } }
I20260808 08:37:10.866384 21489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [sys.catalog]: This master's current role is: LEADER
I20260808 08:37:10.872516 21502 catalog_manager.cc:1259] Loaded cluster ID: 57c97577c055439286d818b8c991b44d
I20260808 08:37:10.872617 21502 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: loading cluster ID for follower catalog manager: success
W20260808 08:37:10.874555 21502 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: acquiring CA information for follower catalog manager: Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG
W20260808 08:37:10.874701 21502 catalog_manager.cc:873] Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG: failed to prepare follower catalog manager, will retry
I20260808 08:37:10.874838 21504 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:37:10.878206 21504 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:37:10.879463 21504 catalog_manager.cc:1259] Loaded cluster ID: 57c97577c055439286d818b8c991b44d
I20260808 08:37:10.879571 21504 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:37:10.882218 21504 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 08:37:10.899650 21504 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 08:37:10.909420 21504 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:37:10.911298 21504 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: Loaded TSK: 0
I20260808 08:37:10.912828 21504 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:37:11.152529 21486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:11.152850 21486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:11.153039 21486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:11.160712 21486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:11.160872 21486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:11.161053 21486 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:37:11.170869 21486 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:36049
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=33551
--tserver_master_addrs=127.5.164.254:37351
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:11.172168 21486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:11.173538 21486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:11.188261 21514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:11.188181 21513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:11.189020 21517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:11.189597 21486 server_base.cc:1034] running on GCE node
I20260808 08:37:11.190272 21486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:11.191286 21486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:11.192531 21486 hybrid_clock.cc:648] HybridClock initialized: now 1786178231192452 us; error 63 us; skew 500 ppm
I20260808 08:37:11.192859 21486 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:11 dist-test-slave-chsk krb5kdc[20816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178231, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:11.196398 21486 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:37:11.197914 21486 webserver.cc:460] Webserver started at http://127.5.164.193:33551/ using document root <none> and password file <none>
I20260808 08:37:11.198606 21486 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:11.198770 21486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:11.204195 21486 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:37:11.207114 21524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:11.208528 21486 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:37:11.208722 21486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "6a4ed1bbddb5409d97456cb459336bcb"
format_stamp: "Formatted at 2026-08-08 08:37:07 on dist-test-slave-chsk"
server_key: "fc7633628ca87887c53d1f56ebb3d09f"
server_key_iv: "6600e12517c04e4e24ae14fa1fee85b8"
server_key_version: "encryptionkey@0"
I20260808 08:37:11.209692 21486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:11.248900 21486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:11.253398 21486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:11.253695 21486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:11.254719 21486 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:37:11.256274 21486 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:37:11.256409 21486 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:11.256546 21486 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:37:11.256635 21486 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:11.290892 21486 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:36049
I20260808 08:37:11.290987 21642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:36049 every 8 connection(s)
I20260808 08:37:11.292471 21486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:37:11.297185 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 21486
I20260808 08:37:11.298005 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:38967
--local_ip_for_outbound_sockets=127.5.164.194
--tserver_master_addrs=127.5.164.254:37351
--webserver_port=43065
--webserver_interface=127.5.164.194
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:37:11 dist-test-slave-chsk krb5kdc[20816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178231, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:11.321272 21646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:11.295592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:51071)
0808 08:37:11.296490 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:11.296557 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:11.299267 (+ 2710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:11.300711 (+ 1444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:11.300729 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:11.301557 (+ 828us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:11.302389 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:11.302420 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:11.304185 (+ 1765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:11.304194 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:11.306349 (+ 2155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:11.306376 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:11.307535 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:11.307547 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:11.307864 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:11.308737 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:11.308760 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:11.311374 (+ 2614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:11.316624 (+ 5250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:11.316631 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:11.316644 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:11.317237 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:11.317819 (+ 582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:11.317823 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:11.317826 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:11.318026 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:11.319117 (+ 1091us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:11.319132 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:11.319510 (+ 378us) client_negotiation.cc:769] Sending connection context
0808 08:37:11.319755 (+ 245us) client_negotiation.cc:240] Negotiation successful
0808 08:37:11.320189 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":338,"threads_started":1}
I20260808 08:37:11.321867 21645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:11.295399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:51071 (local address 127.5.164.254:37351)
0808 08:37:11.296096 (+ 697us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:11.296116 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:11.296731 (+ 615us) server_negotiation.cc:407] Connection header received
0808 08:37:11.299835 (+ 3104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:11.299848 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:11.300191 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:11.300483 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:11.302637 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:11.304001 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:11.306530 (+ 2529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:11.307280 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:11.307425 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:11.311714 (+ 4289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:11.311723 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:11.311739 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:11.311811 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:11.316417 (+ 4606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:11.317406 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:11.317418 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:11.317429 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:11.317656 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:11.318163 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:11.318171 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:11.318178 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:11.318964 (+ 786us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:11.319200 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:11.320043 (+ 843us) server_negotiation.cc:299] Negotiation successful
0808 08:37:11.320493 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":282,"threads_started":1}
I20260808 08:37:11.324718 21643 heartbeater.cc:347] Connected to a master server at 127.5.164.254:37351
I20260808 08:37:11.325030 21643 heartbeater.cc:464] Registering TS with master...
I20260808 08:37:11.325775 21643 heartbeater.cc:511] Master 127.5.164.254:37351 requested a full tablet report, sending...
I20260808 08:37:11.327993 21448 ts_manager.cc:194] Registered new tserver with Master: 6a4ed1bbddb5409d97456cb459336bcb (127.5.164.193:36049)
I20260808 08:37:11.329435 21448 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:51071
W20260808 08:37:11.644771 21647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:11.645131 21647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:11.645288 21647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:11.653260 21647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:11.653412 21647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:11.653642 21647 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:37:11.663897 21647 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:38967
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=43065
--tserver_master_addrs=127.5.164.254:37351
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:11.665634 21647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:11.666994 21647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:11.680553 21656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:11.680641 21658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:11.680620 21655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:11.681411 21647 server_base.cc:1034] running on GCE node
I20260808 08:37:11.682024 21647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:11.683008 21647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:11.684265 21647 hybrid_clock.cc:648] HybridClock initialized: now 1786178231684229 us; error 28 us; skew 500 ppm
I20260808 08:37:11.684625 21647 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:11 dist-test-slave-chsk krb5kdc[20816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178231, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:11.687862 21647 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:37:11.689422 21647 webserver.cc:460] Webserver started at http://127.5.164.194:43065/ using document root <none> and password file <none>
I20260808 08:37:11.690164 21647 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:11.690338 21647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:11.695925 21647 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 08:37:11.698675 21666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:11.700179 21647 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:37:11.700382 21647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "3ac12b45831d4a70baff01c33f338144"
format_stamp: "Formatted at 2026-08-08 08:37:08 on dist-test-slave-chsk"
server_key: "6ab0c75e1248567010ff02a73fa0a54e"
server_key_iv: "2b962900b347effdba2eedc41d22506c"
server_key_version: "encryptionkey@0"
I20260808 08:37:11.701468 21647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:11.728063 21647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:11.734145 21647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:11.734520 21647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:11.735834 21647 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:37:11.737236 21647 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:37:11.737336 21647 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:11.737419 21647 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:37:11.737476 21647 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:11.771483 21647 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:38967
I20260808 08:37:11.771574 21786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:38967 every 8 connection(s)
I20260808 08:37:11.772946 21647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:37:11.774513 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 21647
I20260808 08:37:11.775332 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:41819
--local_ip_for_outbound_sockets=127.5.164.195
--tserver_master_addrs=127.5.164.254:37351
--webserver_port=41027
--webserver_interface=127.5.164.195
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:37:11 dist-test-slave-chsk krb5kdc[20816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178231, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:11.796764 21645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:11.775922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:49317 (local address 127.5.164.254:37351)
0808 08:37:11.776120 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:11.776125 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:11.777496 (+ 1371us) server_negotiation.cc:407] Connection header received
0808 08:37:11.779450 (+ 1954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:11.779457 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:11.779555 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:11.779670 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:11.781182 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:11.781887 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:11.783573 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:11.784034 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:11.784178 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:11.788503 (+ 4325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:11.788512 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:11.788520 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:11.788569 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:11.792648 (+ 4079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:11.793668 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:11.793676 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:11.793683 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:11.793853 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:11.794364 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:11.794372 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:11.794378 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:11.794869 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:11.795042 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:11.796024 (+ 982us) server_negotiation.cc:299] Negotiation successful
0808 08:37:11.796318 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:37:11.798041 21789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:11.776540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:49317)
0808 08:37:11.777326 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:11.777372 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:11.779104 (+ 1732us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:11.779922 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:11.779931 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:11.780443 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:11.781003 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:11.781020 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:11.782070 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:11.782075 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:11.783394 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:11.783407 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:11.784287 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:11.784294 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:11.784534 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:11.785256 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:11.785280 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:11.788237 (+ 2957us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:11.792828 (+ 4591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:11.792838 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:11.792855 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:11.793503 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:11.793987 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:11.793992 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:11.793996 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:11.794231 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:11.795036 (+ 805us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:11.795044 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:11.795563 (+ 519us) client_negotiation.cc:769] Sending connection context
0808 08:37:11.795855 (+ 292us) client_negotiation.cc:240] Negotiation successful
0808 08:37:11.796394 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":324,"threads_started":1}
I20260808 08:37:11.799799 21787 heartbeater.cc:347] Connected to a master server at 127.5.164.254:37351
I20260808 08:37:11.800160 21787 heartbeater.cc:464] Registering TS with master...
I20260808 08:37:11.801127 21787 heartbeater.cc:511] Master 127.5.164.254:37351 requested a full tablet report, sending...
I20260808 08:37:11.802992 21448 ts_manager.cc:194] Registered new tserver with Master: 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967)
I20260808 08:37:11.804171 21448 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:49317
W20260808 08:37:12.125469 21790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:12.125808 21790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:12.125985 21790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:12.133399 21790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:12.133561 21790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:12.133749 21790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:37:12.143659 21790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:41819
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=41027
--tserver_master_addrs=127.5.164.254:37351
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:12.145013 21790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:12.146385 21790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:12.161096 21795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:12.161022 21798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:12.161059 21796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:12.161840 21790 server_base.cc:1034] running on GCE node
I20260808 08:37:12.162480 21790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:12.163516 21790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:12.164752 21790 hybrid_clock.cc:648] HybridClock initialized: now 1786178232164706 us; error 61 us; skew 500 ppm
I20260808 08:37:12.165079 21790 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:12 dist-test-slave-chsk krb5kdc[20816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178232, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:12.168377 21790 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:37:12.169889 21790 webserver.cc:460] Webserver started at http://127.5.164.195:41027/ using document root <none> and password file <none>
I20260808 08:37:12.170598 21790 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:12.170759 21790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:12.176158 21790 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:37:12.178903 21805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:12.180377 21790 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:37:12.180562 21790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "267fe901cac445a2b2de1301232cbd0b"
format_stamp: "Formatted at 2026-08-08 08:37:09 on dist-test-slave-chsk"
server_key: "b845c051ec406b81cdfafb1990f5057f"
server_key_iv: "37664ad9d9ef60e3bc6a3236a1f20adc"
server_key_version: "encryptionkey@0"
I20260808 08:37:12.181499 21790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:12.197111 21790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:12.201234 21790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:12.201521 21790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:12.202561 21790 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:37:12.203956 21790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:37:12.204056 21790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:12.204208 21790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:37:12.204288 21790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:12.239871 21790 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:41819
I20260808 08:37:12.239939 21925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:41819 every 8 connection(s)
I20260808 08:37:12.241320 21790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:37:12.250272 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 21790
Aug 08 08:37:12 dist-test-slave-chsk krb5kdc[20816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178232, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:12.263888 21645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.243904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:56295 (local address 127.5.164.254:37351)
0808 08:37:12.244124 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:12.244129 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:12.245322 (+ 1193us) server_negotiation.cc:407] Connection header received
0808 08:37:12.247379 (+ 2057us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:12.247385 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:12.247477 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:12.247596 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:12.249032 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.249794 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.252233 (+ 2439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.252777 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.252908 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.256982 (+ 4074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:12.256990 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:12.256996 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:12.257037 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:12.260758 (+ 3721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:12.261454 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:12.261460 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:12.261464 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:12.261630 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:12.262119 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:12.262124 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:12.262127 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:12.262389 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:12.262565 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:12.263271 (+ 706us) server_negotiation.cc:299] Negotiation successful
0808 08:37:12.263492 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"spinlock_wait_cycles":768}
I20260808 08:37:12.264789 21928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.244399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:56295)
0808 08:37:12.245142 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:12.245184 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:12.247003 (+ 1819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:12.247830 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:12.247838 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:12.248336 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:12.248856 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:12.248872 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.249991 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.249996 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:12.252090 (+ 2094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:12.252106 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.253066 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.253075 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:12.253383 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.254167 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:12.254221 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:12.256769 (+ 2548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:12.260898 (+ 4129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:12.260904 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:12.260915 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:12.261315 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:12.261756 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:12.261763 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:12.261769 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:12.261976 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:12.262529 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:12.262537 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:12.262861 (+ 324us) client_negotiation.cc:769] Sending connection context
0808 08:37:12.263118 (+ 257us) client_negotiation.cc:240] Negotiation successful
0808 08:37:12.263656 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":307,"threads_started":1}
I20260808 08:37:12.266324 21926 heartbeater.cc:347] Connected to a master server at 127.5.164.254:37351
I20260808 08:37:12.266637 21926 heartbeater.cc:464] Registering TS with master...
I20260808 08:37:12.267347 21929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.251304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55160 (local address 127.5.164.254:37351)
0808 08:37:12.251884 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:12.251889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:12.252658 (+ 769us) server_negotiation.cc:407] Connection header received
0808 08:37:12.252716 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:12.252720 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:12.252790 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:12.252886 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:12.254700 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.255766 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.257542 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.258002 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.258095 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.261560 (+ 3465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:12.261565 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:12.261569 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:12.261598 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:12.264469 (+ 2871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:12.265172 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:12.265176 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:12.265178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:12.265287 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:12.265862 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:12.265868 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:12.265875 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:12.266148 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:12.266414 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:12.266723 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 08:37:12.266937 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":289,"threads_started":1}
I20260808 08:37:12.267537 21926 heartbeater.cc:511] Master 127.5.164.254:37351 requested a full tablet report, sending...
I20260808 08:37:12.269217 21447 ts_manager.cc:194] Registered new tserver with Master: 267fe901cac445a2b2de1301232cbd0b (127.5.164.195:41819)
I20260808 08:37:12.270195 21447 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:56295
I20260808 08:37:12.282090 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:37:12.288856 21929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.283084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55170 (local address 127.5.164.254:37351)
0808 08:37:12.283319 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:12.283328 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:12.283696 (+ 368us) server_negotiation.cc:407] Connection header received
0808 08:37:12.283868 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:12.283872 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:12.284011 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:12.284146 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:37:12.284524 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.285207 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.286702 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.287118 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.287276 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.287735 (+ 459us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:37:12.288263 (+ 528us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:37:12.288371 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:12.288473 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 08:37:12.288548 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:37:12.289839 21447 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:55170:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:37:12.299715 21447 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:37:12.324041 21942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.313730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58860 (local address 127.5.164.193:36049)
0808 08:37:12.315674 (+ 1944us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:12.315684 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:12.315713 (+ 29us) server_negotiation.cc:407] Connection header received
0808 08:37:12.315804 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:12.315811 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:12.316049 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:12.316266 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:12.317420 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.318694 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.321185 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.322743 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.322891 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.323126 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:12.323480 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 08:37:12.323668 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1752,"thread_start_us":1617,"threads_started":1}
I20260808 08:37:12.324139 21939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.313292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:36049 (local address 127.0.0.1:58860)
0808 08:37:12.314947 (+ 1655us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:12.314964 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:12.315117 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:12.316272 (+ 1155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:12.316277 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:12.316307 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:12.317154 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:12.317171 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.318931 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.318936 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:12.321026 (+ 2090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:12.321038 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.322966 (+ 1928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.322973 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:12.323204 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.323268 (+ 64us) client_negotiation.cc:769] Sending connection context
0808 08:37:12.323411 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 08:37:12.323637 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1524,"mutex_wait_us":486,"thread_start_us":450,"threads_started":1}
I20260808 08:37:12.324635 21937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.311742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:41819 (local address 127.0.0.1:54424)
0808 08:37:12.312880 (+ 1138us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:12.312916 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:12.313081 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:12.315804 (+ 2723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:12.315812 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:12.315842 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:12.316323 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:12.316342 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.318833 (+ 2491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.318842 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:12.321712 (+ 2870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:12.321733 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.323601 (+ 1868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.323609 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:12.323837 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.323877 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 08:37:12.323951 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 08:37:12.324136 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":916,"mutex_wait_us":79,"thread_start_us":770,"threads_started":1}
I20260808 08:37:12.324726 21941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.312276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:38967 (local address 127.0.0.1:49844)
0808 08:37:12.314046 (+ 1770us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:12.314063 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:12.314174 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:12.316588 (+ 2414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:12.316593 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:12.316620 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:12.317090 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:12.317104 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.319112 (+ 2008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.319116 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:12.321807 (+ 2691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:12.321819 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.323747 (+ 1928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.323759 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:12.323947 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.323978 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 08:37:12.324082 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 08:37:12.324237 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1596,"mutex_wait_us":70,"thread_start_us":2149,"threads_started":1}
I20260808 08:37:12.325768 21940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.312913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49844 (local address 127.5.164.194:38967)
0808 08:37:12.315986 (+ 3073us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:12.315992 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:12.316013 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:37:12.316104 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:12.316109 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:12.316331 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:12.316590 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:12.317338 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.318948 (+ 1610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.322008 (+ 3060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.323480 (+ 1472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.325065 (+ 1585us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.325205 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:12.325261 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 08:37:12.325437 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2934,"thread_start_us":2795,"threads_started":1}
I20260808 08:37:12.325785 21938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.311999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54424 (local address 127.5.164.195:41819)
0808 08:37:12.315109 (+ 3110us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:12.315119 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:12.315152 (+ 33us) server_negotiation.cc:407] Connection header received
0808 08:37:12.315289 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:12.315301 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:12.315569 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:12.316584 (+ 1015us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:12.316864 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.318657 (+ 1793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.321904 (+ 3247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.323327 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.324959 (+ 1632us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.325183 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:12.325257 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 08:37:12.325427 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2893,"thread_start_us":2753,"threads_started":1}
I20260808 08:37:12.328661 21858 tablet_service.cc:1467] Processing CreateTablet for tablet e4bbc93d449d45269ddc05bf7cb71bb7 (DEFAULT_TABLE table=test-table [id=22f88a94a14849a8805ed42b4ca999fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:37:12.328577 21575 tablet_service.cc:1467] Processing CreateTablet for tablet e4bbc93d449d45269ddc05bf7cb71bb7 (DEFAULT_TABLE table=test-table [id=22f88a94a14849a8805ed42b4ca999fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:37:12.329069 21716 tablet_service.cc:1467] Processing CreateTablet for tablet e4bbc93d449d45269ddc05bf7cb71bb7 (DEFAULT_TABLE table=test-table [id=22f88a94a14849a8805ed42b4ca999fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:37:12.329937 21858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4bbc93d449d45269ddc05bf7cb71bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:12.330034 21575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4bbc93d449d45269ddc05bf7cb71bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:12.330315 21716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4bbc93d449d45269ddc05bf7cb71bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:12.332446 21643 heartbeater.cc:503] Master 127.5.164.254:37351 was elected leader, sending a full tablet report...
I20260808 08:37:12.342639 21943 tablet_bootstrap.cc:492] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b: Bootstrap starting.
I20260808 08:37:12.345651 21945 tablet_bootstrap.cc:492] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144: Bootstrap starting.
I20260808 08:37:12.346753 21944 tablet_bootstrap.cc:492] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb: Bootstrap starting.
I20260808 08:37:12.347087 21943 tablet_bootstrap.cc:654] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:12.348423 21943 log.cc:824] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:12.350538 21945 tablet_bootstrap.cc:654] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:12.351692 21943 tablet_bootstrap.cc:492] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b: No bootstrap required, opened a new log
I20260808 08:37:12.351824 21945 log.cc:824] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:12.351996 21943 ts_tablet_manager.cc:1397] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260808 08:37:12.352514 21944 tablet_bootstrap.cc:654] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:12.353892 21944 log.cc:824] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:12.356199 21945 tablet_bootstrap.cc:492] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144: No bootstrap required, opened a new log
I20260808 08:37:12.356488 21945 ts_tablet_manager.cc:1397] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260808 08:37:12.357018 21944 tablet_bootstrap.cc:492] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb: No bootstrap required, opened a new log
I20260808 08:37:12.357296 21944 ts_tablet_manager.cc:1397] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260808 08:37:12.361292 21943 raft_consensus.cc:348] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } }
I20260808 08:37:12.361667 21943 raft_consensus.cc:374] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:12.361796 21943 raft_consensus.cc:729] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 267fe901cac445a2b2de1301232cbd0b, State: Initialized, Role: FOLLOWER
I20260808 08:37:12.362444 21943 consensus_queue.cc:260] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } }
I20260808 08:37:12.367621 21945 raft_consensus.cc:348] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } }
I20260808 08:37:12.367951 21926 heartbeater.cc:503] Master 127.5.164.254:37351 was elected leader, sending a full tablet report...
I20260808 08:37:12.368098 21945 raft_consensus.cc:374] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:12.367921 21944 raft_consensus.cc:348] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } }
I20260808 08:37:12.368191 21945 raft_consensus.cc:729] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ac12b45831d4a70baff01c33f338144, State: Initialized, Role: FOLLOWER
I20260808 08:37:12.368327 21944 raft_consensus.cc:374] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:12.368410 21944 raft_consensus.cc:729] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a4ed1bbddb5409d97456cb459336bcb, State: Initialized, Role: FOLLOWER
I20260808 08:37:12.368718 21943 ts_tablet_manager.cc:1428] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b: Time spent starting tablet: real 0.017s user 0.012s sys 0.003s
I20260808 08:37:12.368920 21945 consensus_queue.cc:260] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } }
I20260808 08:37:12.369015 21944 consensus_queue.cc:260] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } }
I20260808 08:37:12.370146 21787 heartbeater.cc:503] Master 127.5.164.254:37351 was elected leader, sending a full tablet report...
I20260808 08:37:12.371371 21944 ts_tablet_manager.cc:1428] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb: Time spent starting tablet: real 0.014s user 0.015s sys 0.001s
I20260808 08:37:12.372911 21945 ts_tablet_manager.cc:1428] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
W20260808 08:37:12.492974 21927 tablet.cc:2369] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:37:12.525110 21788 tablet.cc:2369] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:37:12.544981 21644 tablet.cc:2369] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:37:12.575459 21949 raft_consensus.cc:482] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:37:12.575762 21949 raft_consensus.cc:504] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } }
I20260808 08:37:12.577414 21949 leader_election.cc:288] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a4ed1bbddb5409d97456cb459336bcb (127.5.164.193:36049), 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967)
I20260808 08:37:12.584692 21942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.577774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:56157 (local address 127.5.164.193:36049)
0808 08:37:12.577996 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:12.578003 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:12.578186 (+ 183us) server_negotiation.cc:407] Connection header received
0808 08:37:12.578501 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:12.578507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:12.578589 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:12.578678 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:12.579201 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.580207 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.582552 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.583829 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.584012 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.584090 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:12.584317 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 08:37:12.584433 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:37:12.584765 21928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.577675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:36049 (local address 127.5.164.195:56157)
0808 08:37:12.578069 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:12.578090 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:12.578251 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:12.578736 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:12.578744 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:12.578781 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:12.579020 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:12.579031 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.580343 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.580346 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:12.582394 (+ 2048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:12.582408 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.583975 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.583979 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:12.584114 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.584149 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 08:37:12.584290 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 08:37:12.584433 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"spinlock_wait_cycles":23296}
I20260808 08:37:12.585157 21940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.578204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:50443 (local address 127.5.164.194:38967)
0808 08:37:12.578441 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:12.578449 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:12.578846 (+ 397us) server_negotiation.cc:407] Connection header received
0808 08:37:12.579016 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:12.579021 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:12.579107 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:12.579236 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:12.579714 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.580619 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.582841 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.584090 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.584222 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.584316 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:12.584748 (+ 432us) server_negotiation.cc:299] Negotiation successful
0808 08:37:12.584911 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:37:12.585238 21953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.577961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:38967 (local address 127.5.164.195:50443)
0808 08:37:12.578732 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:12.578748 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:12.578886 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:12.579249 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:12.579252 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:12.579274 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:12.579548 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:12.579555 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.580761 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.580770 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:12.582694 (+ 1924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:12.582703 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.584301 (+ 1598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.584306 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:12.584464 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.584494 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 08:37:12.584657 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 08:37:12.584804 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"mutex_wait_us":1,"spinlock_wait_cycles":768,"thread_start_us":440,"threads_started":1}
I20260808 08:37:12.586066 21596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4bbc93d449d45269ddc05bf7cb71bb7" candidate_uuid: "267fe901cac445a2b2de1301232cbd0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a4ed1bbddb5409d97456cb459336bcb" is_pre_election: true
I20260808 08:37:12.586300 21739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4bbc93d449d45269ddc05bf7cb71bb7" candidate_uuid: "267fe901cac445a2b2de1301232cbd0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ac12b45831d4a70baff01c33f338144" is_pre_election: true
I20260808 08:37:12.586675 21596 raft_consensus.cc:2454] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 267fe901cac445a2b2de1301232cbd0b in term 0.
I20260808 08:37:12.586843 21739 raft_consensus.cc:2454] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 267fe901cac445a2b2de1301232cbd0b in term 0.
I20260808 08:37:12.587394 21808 leader_election.cc:302] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 267fe901cac445a2b2de1301232cbd0b, 6a4ed1bbddb5409d97456cb459336bcb; no voters:
I20260808 08:37:12.587818 21949 raft_consensus.cc:2781] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:37:12.587970 21949 raft_consensus.cc:482] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:37:12.588099 21949 raft_consensus.cc:3037] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:12.590384 21949 raft_consensus.cc:504] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } }
I20260808 08:37:12.590998 21949 leader_election.cc:288] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [CANDIDATE]: Term 1 election: Requested vote from peers 6a4ed1bbddb5409d97456cb459336bcb (127.5.164.193:36049), 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967)
I20260808 08:37:12.591511 21596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4bbc93d449d45269ddc05bf7cb71bb7" candidate_uuid: "267fe901cac445a2b2de1301232cbd0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a4ed1bbddb5409d97456cb459336bcb"
I20260808 08:37:12.591533 21739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4bbc93d449d45269ddc05bf7cb71bb7" candidate_uuid: "267fe901cac445a2b2de1301232cbd0b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ac12b45831d4a70baff01c33f338144"
I20260808 08:37:12.591723 21596 raft_consensus.cc:3037] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:12.591737 21739 raft_consensus.cc:3037] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:12.593888 21739 raft_consensus.cc:2454] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 267fe901cac445a2b2de1301232cbd0b in term 1.
I20260808 08:37:12.593900 21596 raft_consensus.cc:2454] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 267fe901cac445a2b2de1301232cbd0b in term 1.
I20260808 08:37:12.594314 21810 leader_election.cc:302] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 267fe901cac445a2b2de1301232cbd0b, 3ac12b45831d4a70baff01c33f338144; no voters:
I20260808 08:37:12.594648 21949 raft_consensus.cc:2781] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:37:12.595193 21949 raft_consensus.cc:686] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [term 1 LEADER]: Becoming Leader. State: Replica: 267fe901cac445a2b2de1301232cbd0b, State: Running, Role: LEADER
I20260808 08:37:12.595736 21949 consensus_queue.cc:237] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } }
I20260808 08:37:12.600234 21447 catalog_manager.cc:5495] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b reported cstate change: term changed from 0 to 1, leader changed from <none> to 267fe901cac445a2b2de1301232cbd0b (127.5.164.195). New cstate: current_term: 1 leader_uuid: "267fe901cac445a2b2de1301232cbd0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } health_report { overall_health: UNKNOWN } } }
I20260808 08:37:12.621043 21938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.615038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54426 (local address 127.5.164.195:41819)
0808 08:37:12.615294 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:12.615300 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:12.615321 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:37:12.615505 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:12.615510 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:12.615599 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:12.615752 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:37:12.616127 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.616858 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.618412 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.618818 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.618967 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.619621 (+ 654us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:37:12.620245 (+ 624us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:37:12.620429 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:12.620597 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 08:37:12.620705 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 08:37:12.629487 21596 raft_consensus.cc:1261] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Refusing update from remote peer 267fe901cac445a2b2de1301232cbd0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:37:12.629489 21739 raft_consensus.cc:1261] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144 [term 1 FOLLOWER]: Refusing update from remote peer 267fe901cac445a2b2de1301232cbd0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:37:12.630657 21954 consensus_queue.cc:1035] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:37:12.631059 21949 consensus_queue.cc:1035] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:37:12.644150 21958 mvcc.cc:205] Tried to move back new op lower bound from 7316186040839430144 to 7316186040716070912. Current Snapshot: MvccSnapshot[applied={T|T < 7316186040839430144}]
I20260808 08:37:12.646584 21957 mvcc.cc:205] Tried to move back new op lower bound from 7316186040839430144 to 7316186040716070912. Current Snapshot: MvccSnapshot[applied={T|T < 7316186040839430144}]
I20260808 08:37:12.657931 21448 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:55170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:37:12.658209 21448 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:55170:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:37:12.662039 21448 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: Sending DeleteTablet for 3 replicas of tablet e4bbc93d449d45269ddc05bf7cb71bb7
I20260808 08:37:12.663290 21858 tablet_service.cc:1514] Processing DeleteTablet for tablet e4bbc93d449d45269ddc05bf7cb71bb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:37:12 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:54424
I20260808 08:37:12.663477 21575 tablet_service.cc:1514] Processing DeleteTablet for tablet e4bbc93d449d45269ddc05bf7cb71bb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:37:12 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:58860
I20260808 08:37:12.664027 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 21486
I20260808 08:37:12.664690 21716 tablet_service.cc:1514] Processing DeleteTablet for tablet e4bbc93d449d45269ddc05bf7cb71bb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:37:12 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:49844
I20260808 08:37:12.688599 21942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.665102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58874 (local address 127.5.164.193:36049)
0808 08:37:12.665286 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:12.665292 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:12.665410 (+ 118us) server_negotiation.cc:407] Connection header received
0808 08:37:12.665622 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:12.665630 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:12.665710 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:12.665843 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:12.668010 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.669472 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.672436 (+ 2964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.673325 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.673468 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.678036 (+ 4568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:12.678060 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:12.678082 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:12.678127 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:12.683134 (+ 5007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:12.684419 (+ 1285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:12.684432 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:12.684438 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:12.684669 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:12.685204 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:12.685212 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:12.685218 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:12.685841 (+ 623us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:12.686193 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:12.687715 (+ 1522us) server_negotiation.cc:299] Negotiation successful
0808 08:37:12.688018 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 08:37:12.689894 21637 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:12.690402 21968 tablet_replica.cc:330] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144: stopping tablet replica
I20260808 08:37:12.691550 21968 raft_consensus.cc:2229] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:37:12.692365 21965 tablet_replica.cc:330] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b: stopping tablet replica
I20260808 08:37:12.693209 21968 raft_consensus.cc:2258] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:37:12.693945 21965 raft_consensus.cc:2229] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:37:12.694746 21965 raft_consensus.cc:2258] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:37:12.697016 21965 ts_tablet_manager.cc:1905] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:37:12.697016 21968 ts_tablet_manager.cc:1905] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:37:12.704594 21968 ts_tablet_manager.cc:1918] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:37:12.704802 21968 log.cc:1196] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/e4bbc93d449d45269ddc05bf7cb71bb7
I20260808 08:37:12.705241 21965 ts_tablet_manager.cc:1918] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:37:12.705436 21968 ts_tablet_manager.cc:1939] T e4bbc93d449d45269ddc05bf7cb71bb7 P 3ac12b45831d4a70baff01c33f338144: Deleting consensus metadata
I20260808 08:37:12.705629 21965 log.cc:1196] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/e4bbc93d449d45269ddc05bf7cb71bb7
I20260808 08:37:12.706278 21965 ts_tablet_manager.cc:1939] T e4bbc93d449d45269ddc05bf7cb71bb7 P 267fe901cac445a2b2de1301232cbd0b: Deleting consensus metadata
I20260808 08:37:12.707762 21434 catalog_manager.cc:4841] TS 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967): tablet e4bbc93d449d45269ddc05bf7cb71bb7 (table test-table [id=22f88a94a14849a8805ed42b4ca999fd]) successfully deleted
I20260808 08:37:12.708292 21433 catalog_manager.cc:4841] TS 267fe901cac445a2b2de1301232cbd0b (127.5.164.195:41819): tablet e4bbc93d449d45269ddc05bf7cb71bb7 (table test-table [id=22f88a94a14849a8805ed42b4ca999fd]) successfully deleted
I20260808 08:37:12.841004 21967 tablet_replica.cc:330] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb: stopping tablet replica
I20260808 08:37:12.841570 21967 raft_consensus.cc:2229] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:37:12.842154 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 21486
I20260808 08:37:12.842235 21967 raft_consensus.cc:2258] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 08:37:12.863993 21433 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.164.193:36049 (error 108)
I20260808 08:37:12.864326 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 21647
I20260808 08:37:12.866655 21972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.865898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:36049 (local address 127.0.0.1:58882)
0808 08:37:12.866390 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:12.866494 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:36049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":276,"threads_started":1}
W20260808 08:37:12.866966 21433 catalog_manager.cc:4584] TS 6a4ed1bbddb5409d97456cb459336bcb (127.5.164.193:36049): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e4bbc93d449d45269ddc05bf7cb71bb7: Network error: Client connection negotiation failed: client connection to 127.5.164.193:36049: connect: Connection refused (error 111)
I20260808 08:37:12.881273 21940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.865254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49858 (local address 127.5.164.194:38967)
0808 08:37:12.865442 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:12.865449 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:12.865470 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:37:12.865691 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:12.865697 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:12.865791 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:12.865897 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:12.867770 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.868500 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.870525 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:12.870918 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:12.871026 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:12.874607 (+ 3581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:12.874624 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:12.874640 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:12.874684 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:12.877923 (+ 3239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:12.878927 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:12.878935 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:12.878937 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:12.879117 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:12.879630 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:12.879633 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:12.879635 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:12.880072 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:12.880307 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:12.880724 (+ 417us) server_negotiation.cc:299] Negotiation successful
0808 08:37:12.880914 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 08:37:12.881999 21781 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:12.920884 21972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.920270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:36049 (local address 127.0.0.1:58888)
0808 08:37:12.920562 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:12.920687 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:36049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260808 08:37:12.922295 21972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.921806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:36049 (local address 127.0.0.1:58900)
0808 08:37:12.921983 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:12.922102 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:36049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 08:37:12.975775 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 21647
I20260808 08:37:12.983006 21972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.982554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:36049 (local address 127.0.0.1:58902)
0808 08:37:12.982768 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:12.982856 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:36049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 08:37:12.984097 21972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:12.983730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:36049 (local address 127.0.0.1:58906)
0808 08:37:12.983875 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:12.983954 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:36049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 08:37:13.004304 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 21790
I20260808 08:37:13.021430 21938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:13.005146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54430 (local address 127.5.164.195:41819)
0808 08:37:13.005350 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:13.005354 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:13.005458 (+ 104us) server_negotiation.cc:407] Connection header received
0808 08:37:13.005676 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:13.005680 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:13.005743 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:13.005834 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:13.007977 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:13.008820 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:13.010755 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:13.011394 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:13.011497 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:13.015087 (+ 3590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:13.015099 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:13.015118 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:13.015201 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:13.018269 (+ 3068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:13.019244 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:13.019251 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:13.019253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:13.019409 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:13.019850 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:13.019853 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:13.019855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:13.020228 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:13.020482 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:13.020905 (+ 423us) server_negotiation.cc:299] Negotiation successful
0808 08:37:13.021074 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 08:37:13.022274 21921 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:13.065110 21972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:13.064538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:36049 (local address 127.0.0.1:58914)
0808 08:37:13.064835 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:13.064933 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:36049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165}
I20260808 08:37:13.066255 21972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:13.065838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:36049 (local address 127.0.0.1:58926)
0808 08:37:13.066037 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:13.066105 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:36049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260808 08:37:13.149703 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 21790
I20260808 08:37:13.174621 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 21411
I20260808 08:37:13.175860 21479 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:13.291607 21972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:13.291050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:36049 (local address 127.0.0.1:58930)
0808 08:37:13.291317 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:13.291441 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:36049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260808 08:37:13.291603 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 21411
I20260808 08:37:13.317911 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:37351
--webserver_interface=127.5.164.254
--webserver_port=41377
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:37351
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:37:13.677865 21976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:13.678160 21976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:13.678318 21976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:13.685644 21976 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:37:13.685758 21976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:13.685877 21976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:13.685973 21976 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:37:13.686054 21976 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:37:13.696166 21976 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:37351
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:37351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=41377
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:13.697551 21976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:13.698869 21976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:13.711156 21981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:13.711089 21982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:13.711115 21984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:13.712455 21976 server_base.cc:1034] running on GCE node
I20260808 08:37:13.713333 21976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:13.714839 21976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:13.716111 21976 hybrid_clock.cc:648] HybridClock initialized: now 1786178233716077 us; error 122 us; skew 500 ppm
I20260808 08:37:13.716470 21976 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:13 dist-test-slave-chsk krb5kdc[20816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178233, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:13.719808 21976 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:37:13.721405 21976 webserver.cc:460] Webserver started at http://127.5.164.254:41377/ using document root <none> and password file <none>
I20260808 08:37:13.722203 21976 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:13.722357 21976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:13.728127 21976 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 08:37:13.734390 21991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:13.736248 21976 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260808 08:37:13.736438 21976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "629885f48e3d4ed1bbc40ada3f467029"
format_stamp: "Formatted at 2026-08-08 08:37:07 on dist-test-slave-chsk"
server_key: "3fdd6c8af798b3ef66421615c2963c7b"
server_key_iv: "ad9b94add349421b258fb8ad5732de09"
server_key_version: "encryptionkey@0"
I20260808 08:37:13.737710 21976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:13.753664 21976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:13.757735 21976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:13.758010 21976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:13.777397 21976 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:37351
I20260808 08:37:13.777418 22046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:37351 every 8 connection(s)
I20260808 08:37:13.778944 21976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:37:13.785739 22047 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:37:13.787493 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 21976
I20260808 08:37:13.788528 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:36049
--local_ip_for_outbound_sockets=127.5.164.193
--tserver_master_addrs=127.5.164.254:37351
--webserver_port=33551
--webserver_interface=127.5.164.193
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:37:13.790267 22047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: Bootstrap starting.
I20260808 08:37:13.814936 22047 log.cc:824] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:13.831388 22047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:37:13.831930 22047 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029: Bootstrap complete.
I20260808 08:37:13.841691 22047 raft_consensus.cc:348] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } }
I20260808 08:37:13.842800 22047 raft_consensus.cc:729] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 629885f48e3d4ed1bbc40ada3f467029, State: Initialized, Role: FOLLOWER
I20260808 08:37:13.843490 22047 consensus_queue.cc:260] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } }
I20260808 08:37:13.843724 22047 raft_consensus.cc:388] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:37:13.843858 22047 raft_consensus.cc:482] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:37:13.844053 22047 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 2 FOLLOWER]: Advancing to term 3
I20260808 08:37:13.848315 22047 raft_consensus.cc:504] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } }
I20260808 08:37:13.848829 22047 leader_election.cc:302] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 629885f48e3d4ed1bbc40ada3f467029; no voters:
I20260808 08:37:13.849543 22047 leader_election.cc:288] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 08:37:13.849691 22052 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 08:37:13.852006 22047 sys_catalog.cc:564] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:37:13.855432 22052 raft_consensus.cc:686] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [term 3 LEADER]: Becoming Leader. State: Replica: 629885f48e3d4ed1bbc40ada3f467029, State: Running, Role: LEADER
I20260808 08:37:13.856128 22052 consensus_queue.cc:237] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } }
I20260808 08:37:13.859156 22053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "629885f48e3d4ed1bbc40ada3f467029" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } } }
I20260808 08:37:13.859297 22054 sys_catalog.cc:455] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 629885f48e3d4ed1bbc40ada3f467029. Latest consensus state: current_term: 3 leader_uuid: "629885f48e3d4ed1bbc40ada3f467029" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "629885f48e3d4ed1bbc40ada3f467029" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37351 } } }
I20260808 08:37:13.859601 22053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [sys.catalog]: This master's current role is: LEADER
I20260808 08:37:13.859608 22054 sys_catalog.cc:458] T 00000000000000000000000000000000 P 629885f48e3d4ed1bbc40ada3f467029 [sys.catalog]: This master's current role is: LEADER
I20260808 08:37:13.874231 22060 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:37:13.882782 22060 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:37:13.884758 22060 catalog_manager.cc:1259] Loaded cluster ID: 57c97577c055439286d818b8c991b44d
I20260808 08:37:13.884891 22060 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 08:37:13.887941 22060 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7ffb0da4f9ad google::LogMessage::Fail() at ??:0
@ 0x7ffb0da5288a google::LogMessage::SendToLog() at ??:0
@ 0x7ffb0da4f4de google::LogMessage::Flush() at ??:0
@ 0x7ffb0da50a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ffb23486512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7ffb23483976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7ffb2350b610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7ffb2350b439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7ffb1069b345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7ffb1069e91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7ffb1069e799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7ffb10679eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7ffb139536db start_thread at ??:0
@ 0x7ffb0c8e961f clone at ??:0
W20260808 08:37:14.231863 22049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:14.232146 22049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:14.232245 22049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:14.239552 22049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:14.239661 22049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:14.239774 22049 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:37:14.249747 22049 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:36049
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=33551
--tserver_master_addrs=127.5.164.254:37351
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:14.251039 22049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:14.252450 22049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:14.265924 22092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:14.265945 22095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:14.265998 22093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:14.267019 22049 server_base.cc:1034] running on GCE node
I20260808 08:37:14.267704 22049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:14.268628 22049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:14.269860 22049 hybrid_clock.cc:648] HybridClock initialized: now 1786178234269817 us; error 34 us; skew 500 ppm
I20260808 08:37:14.270191 22049 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:14 dist-test-slave-chsk krb5kdc[20816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178234, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:14.273398 22049 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:37:14.274803 22049 webserver.cc:460] Webserver started at http://127.5.164.193:33551/ using document root <none> and password file <none>
I20260808 08:37:14.275529 22049 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:14.275673 22049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:14.280894 22049 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:37:14.283689 22103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:14.284976 22049 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:37:14.285152 22049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "6a4ed1bbddb5409d97456cb459336bcb"
format_stamp: "Formatted at 2026-08-08 08:37:07 on dist-test-slave-chsk"
server_key: "fc7633628ca87887c53d1f56ebb3d09f"
server_key_iv: "6600e12517c04e4e24ae14fa1fee85b8"
server_key_version: "encryptionkey@0"
I20260808 08:37:14.286105 22049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:14.304996 22049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:14.309156 22049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:14.309443 22049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:14.310452 22049 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:37:14.312446 22110 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260808 08:37:14.318097 22049 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 08:37:14.318266 22049 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260808 08:37:14.318413 22049 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 08:37:14.321612 22049 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 08:37:14.321727 22049 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.001s sys 0.000s
I20260808 08:37:14.322106 22110 tablet_bootstrap.cc:492] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb: Bootstrap starting.
I20260808 08:37:14.350471 22110 log.cc:824] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:14.363257 22110 tablet_bootstrap.cc:492] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:37:14.364131 22110 tablet_bootstrap.cc:492] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb: Bootstrap complete.
I20260808 08:37:14.365762 22110 ts_tablet_manager.cc:1397] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb: Time spent bootstrapping tablet: real 0.044s user 0.016s sys 0.024s
I20260808 08:37:14.366863 22049 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:36049
I20260808 08:37:14.366951 22223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:36049 every 8 connection(s)
I20260808 08:37:14.368203 22049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:37:14.373034 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 22049
I20260808 08:37:14.373679 22227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:14.371214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:44955)
0808 08:37:14.372127 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:14.372420 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":371,"threads_started":1}
I20260808 08:37:14.373698 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:38967
--local_ip_for_outbound_sockets=127.5.164.194
--tserver_master_addrs=127.5.164.254:37351
--webserver_port=43065
--webserver_interface=127.5.164.194
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:37:14.374737 22110 raft_consensus.cc:348] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } }
I20260808 08:37:14.375666 22110 raft_consensus.cc:729] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a4ed1bbddb5409d97456cb459336bcb, State: Initialized, Role: FOLLOWER
I20260808 08:37:14.376238 22110 consensus_queue.cc:260] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } }
I20260808 08:37:14.377518 22110 ts_tablet_manager.cc:1428] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
W20260808 08:37:14.379478 22224 heartbeater.cc:644] Failed to heartbeat to 127.5.164.254:37351 (0 consecutive failures): Network error: Failed to ping master at 127.5.164.254:37351: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
I20260808 08:37:14.380358 22227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:14.379997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:40615)
0808 08:37:14.380181 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:14.380250 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 08:37:14.381204 22227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:14.380857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:48283)
0808 08:37:14.380997 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:14.381079 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 08:37:14.381497 22224 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:37:14.719274 22229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:14.719616 22229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:14.719787 22229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:14.727193 22229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:14.727358 22229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:14.727533 22229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:37:14.737414 22229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:38967
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=43065
--tserver_master_addrs=127.5.164.254:37351
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:14.738725 22229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:14.740130 22229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:14.753652 22239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:14.753739 22237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:14.753685 22235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:14.760030 22229 server_base.cc:1034] running on GCE node
I20260808 08:37:14.760689 22229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:14.761667 22229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:14.762921 22229 hybrid_clock.cc:648] HybridClock initialized: now 1786178234762867 us; error 54 us; skew 500 ppm
I20260808 08:37:14.763317 22229 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:14 dist-test-slave-chsk krb5kdc[20816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178234, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:14.766356 22229 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:37:14.767972 22229 webserver.cc:460] Webserver started at http://127.5.164.194:43065/ using document root <none> and password file <none>
I20260808 08:37:14.768704 22229 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:14.768868 22229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:14.774134 22229 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.004s
I20260808 08:37:14.776943 22246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:14.778270 22229 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:37:14.778460 22229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "3ac12b45831d4a70baff01c33f338144"
format_stamp: "Formatted at 2026-08-08 08:37:08 on dist-test-slave-chsk"
server_key: "6ab0c75e1248567010ff02a73fa0a54e"
server_key_iv: "2b962900b347effdba2eedc41d22506c"
server_key_version: "encryptionkey@0"
I20260808 08:37:14.779481 22229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:14.800130 22229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:14.804359 22229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:14.804667 22229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:14.805691 22229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:37:14.807057 22229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:37:14.807209 22229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:14.807345 22229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:37:14.807444 22229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:14.841620 22229 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:38967
I20260808 08:37:14.841682 22367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:38967 every 8 connection(s)
I20260808 08:37:14.843097 22229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:37:14.844745 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 22229
I20260808 08:37:14.845464 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:41819
--local_ip_for_outbound_sockets=127.5.164.195
--tserver_master_addrs=127.5.164.254:37351
--webserver_port=41027
--webserver_interface=127.5.164.195
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:38929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:37:14.857668 22370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:14.846122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:59209)
0808 08:37:14.856458 (+ 10336us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:14.856703 (+ 245us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9982,"thread_start_us":9826,"threads_started":1}
W20260808 08:37:14.858553 22368 heartbeater.cc:644] Failed to heartbeat to 127.5.164.254:37351 (0 consecutive failures): Network error: Failed to ping master at 127.5.164.254:37351: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
I20260808 08:37:14.859472 22370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:14.859111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:40351)
0808 08:37:14.859284 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:14.859360 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260808 08:37:14.860566 22370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:14.860073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:53957)
0808 08:37:14.860264 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:14.860385 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260808 08:37:14.860865 22368 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 08:37:15.179847 22372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:15.180110 22372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:15.180202 22372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:15.187352 22372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:15.187458 22372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:15.187565 22372 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:37:15.197362 22372 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:41819
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=41027
--tserver_master_addrs=127.5.164.254:37351
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:15.198628 22372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:15.199921 22372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:15.213574 22379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:15.213582 22381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:15.214152 22378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:15.214474 22372 server_base.cc:1034] running on GCE node
I20260808 08:37:15.215176 22372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:15.216100 22372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:15.217294 22372 hybrid_clock.cc:648] HybridClock initialized: now 1786178235217241 us; error 51 us; skew 500 ppm
I20260808 08:37:15.217614 22372 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:15 dist-test-slave-chsk krb5kdc[20816](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178235, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:15.220780 22372 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:37:15.222164 22372 webserver.cc:460] Webserver started at http://127.5.164.195:41027/ using document root <none> and password file <none>
I20260808 08:37:15.222856 22372 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:15.223024 22372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:15.228348 22372 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:37:15.230957 22388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:15.232482 22372 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:37:15.232697 22372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "267fe901cac445a2b2de1301232cbd0b"
format_stamp: "Formatted at 2026-08-08 08:37:09 on dist-test-slave-chsk"
server_key: "b845c051ec406b81cdfafb1990f5057f"
server_key_iv: "37664ad9d9ef60e3bc6a3236a1f20adc"
server_key_version: "encryptionkey@0"
I20260808 08:37:15.233819 22372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:15.252897 22372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:15.256906 22372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:15.257193 22372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:15.258204 22372 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:37:15.259563 22372 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:37:15.259678 22372 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:15.259821 22372 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:37:15.259908 22372 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:15.294355 22372 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:41819
I20260808 08:37:15.294409 22508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:41819 every 8 connection(s)
I20260808 08:37:15.295946 22372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:37:15.300566 22511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:15.298764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:42563)
0808 08:37:15.299516 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:15.299771 (+ 255us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":336,"threads_started":1}
W20260808 08:37:15.301303 22509 heartbeater.cc:644] Failed to heartbeat to 127.5.164.254:37351 (0 consecutive failures): Network error: Failed to ping master at 127.5.164.254:37351: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
I20260808 08:37:15.302186 22511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:15.301801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:57569)
0808 08:37:15.301971 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:15.302054 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 08:37:15.303045 22511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:15.302747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:40125)
0808 08:37:15.302861 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:15.302931 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 08:37:15.303344 22509 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 08:37:15.305809 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 22372
I20260808 08:37:15.382925 22513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:15.382089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:48169)
0808 08:37:15.382589 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:15.382687 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":238,"threads_started":1}
I20260808 08:37:15.862437 22514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:15.861490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:37589)
0808 08:37:15.862047 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:15.862164 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":273,"threads_started":1}
I20260808 08:37:16.046104 22515 raft_consensus.cc:482] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:37:16.046481 22515 raft_consensus.cc:504] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } }
I20260808 08:37:16.048336 22515 leader_election.cc:288] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 267fe901cac445a2b2de1301232cbd0b (127.5.164.195:41819), 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967)
Aug 08 08:37:16 dist-test-slave-chsk krb5kdc[20816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178234, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
Aug 08 08:37:16 dist-test-slave-chsk krb5kdc[20816](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178234, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:37:16.087759 22519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:16.049110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:54993 (local address 127.5.164.194:38967)
0808 08:37:16.062045 (+ 12935us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:16.062056 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:16.062091 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:37:16.063958 (+ 1867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:16.063969 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:16.064370 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:16.064716 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:16.065875 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:16.067039 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:16.068891 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:16.069508 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:16.069690 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:16.079286 (+ 9596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:16.079297 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:16.079312 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:16.079362 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:16.082930 (+ 3568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:16.084076 (+ 1146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:16.084084 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:16.084089 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:16.084304 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:16.084819 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:16.084823 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:16.084825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:16.085603 (+ 778us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:16.085803 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:16.086878 (+ 1075us) server_negotiation.cc:299] Negotiation successful
0808 08:37:16.087320 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12763,"thread_start_us":12581,"threads_started":1}
I20260808 08:37:16.087765 22518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:16.048791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:33445 (local address 127.5.164.195:41819)
0808 08:37:16.060073 (+ 11282us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:16.060092 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:16.061568 (+ 1476us) server_negotiation.cc:407] Connection header received
0808 08:37:16.062974 (+ 1406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:16.062982 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:16.063405 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:16.063671 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:16.065872 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:16.067092 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:16.068890 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:16.069528 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:16.069741 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:16.079555 (+ 9814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:16.079563 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:16.079575 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:16.079617 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:16.082942 (+ 3325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:16.084452 (+ 1510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:16.084458 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:16.084463 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:16.084638 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:16.085028 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:16.085033 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:16.085037 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:16.085607 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:16.085803 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:16.086877 (+ 1074us) server_negotiation.cc:299] Negotiation successful
0808 08:37:16.087320 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11089,"thread_start_us":10986,"threads_started":1}
I20260808 08:37:16.087747 22517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:16.048775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:38967 (local address 127.5.164.193:54993)
0808 08:37:16.061115 (+ 12340us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:16.061136 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:16.061297 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:16.064674 (+ 3377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:16.064678 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:16.065366 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:16.065671 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:16.065694 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:16.067287 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:16.067294 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:16.068738 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:16.068750 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:16.069738 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:16.069744 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:16.070014 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:16.075635 (+ 5621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:16.075654 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:16.078811 (+ 3157us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:16.083202 (+ 4391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:16.083208 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:16.083211 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:16.083928 (+ 717us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:16.084406 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:16.084409 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:16.084412 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:16.084656 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:16.085765 (+ 1109us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:16.085774 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:16.086274 (+ 500us) client_negotiation.cc:769] Sending connection context
0808 08:37:16.086597 (+ 323us) client_negotiation.cc:240] Negotiation successful
0808 08:37:16.087308 (+ 711us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12179,"mutex_wait_us":395,"spinlock_wait_cycles":28672,"thread_start_us":11974,"threads_started":1}
I20260808 08:37:16.087771 22516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:16.048547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:41819 (local address 127.5.164.193:33445)
0808 08:37:16.060690 (+ 12143us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:16.060755 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:16.061291 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:16.063857 (+ 2566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:16.063869 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:16.064904 (+ 1035us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:16.065665 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:16.065686 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:16.067302 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:16.067306 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:16.068735 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:16.068749 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:16.069758 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:16.069765 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:16.070006 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:16.075618 (+ 5612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:16.075667 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:16.079238 (+ 3571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:16.083103 (+ 3865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:16.083113 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:16.083130 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:16.083928 (+ 798us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:16.084748 (+ 820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:16.084752 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:16.084756 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:16.084900 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:16.085765 (+ 865us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:16.085774 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:16.086274 (+ 500us) client_negotiation.cc:769] Sending connection context
0808 08:37:16.086597 (+ 323us) client_negotiation.cc:240] Negotiation successful
0808 08:37:16.087207 (+ 610us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11932,"mutex_wait_us":217,"spinlock_wait_cycles":32896,"thread_start_us":11757,"threads_started":1}
W20260808 08:37:16.091229 22106 leader_election.cc:341] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 267fe901cac445a2b2de1301232cbd0b (127.5.164.195:41819): Not found: Tablet not found: e4bbc93d449d45269ddc05bf7cb71bb7
W20260808 08:37:16.091517 22107 leader_election.cc:341] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967): Not found: Tablet not found: e4bbc93d449d45269ddc05bf7cb71bb7
I20260808 08:37:16.091719 22107 leader_election.cc:302] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a4ed1bbddb5409d97456cb459336bcb; no voters: 267fe901cac445a2b2de1301232cbd0b, 3ac12b45831d4a70baff01c33f338144
I20260808 08:37:16.092170 22515 raft_consensus.cc:2726] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:37:16.304795 22520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:16.303916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:52647)
0808 08:37:16.304401 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:16.304549 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":229,"threads_started":1}
I20260808 08:37:16.384655 22516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:16.384033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:48911)
0808 08:37:16.384233 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:16.384422 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 08:37:16.864302 22521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:16.863586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:49293)
0808 08:37:16.864044 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:16.864134 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":254,"threads_started":1}
I20260808 08:37:17.306437 22523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:17.305758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:50657)
0808 08:37:17.306195 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:17.306279 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":234,"threads_started":1}
I20260808 08:37:17.386441 22524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:17.385645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:48297)
0808 08:37:17.386156 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:17.386244 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":241,"threads_started":1}
I20260808 08:37:17.749689 22525 raft_consensus.cc:482] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:37:17.749900 22525 raft_consensus.cc:504] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } }
I20260808 08:37:17.750730 22525 leader_election.cc:288] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 267fe901cac445a2b2de1301232cbd0b (127.5.164.195:41819), 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967)
W20260808 08:37:17.751770 22106 leader_election.cc:341] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 267fe901cac445a2b2de1301232cbd0b (127.5.164.195:41819): Not found: Tablet not found: e4bbc93d449d45269ddc05bf7cb71bb7
W20260808 08:37:17.751972 22107 leader_election.cc:341] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967): Not found: Tablet not found: e4bbc93d449d45269ddc05bf7cb71bb7
I20260808 08:37:17.752131 22107 leader_election.cc:302] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a4ed1bbddb5409d97456cb459336bcb; no voters: 267fe901cac445a2b2de1301232cbd0b, 3ac12b45831d4a70baff01c33f338144
I20260808 08:37:17.752437 22525 raft_consensus.cc:2726] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:37:17.866197 22526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:17.865395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:42561)
0808 08:37:17.865919 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:17.866013 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":273,"threads_started":1}
I20260808 08:37:18.308331 22527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:18.307559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:40363)
0808 08:37:18.308062 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:18.308155 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":266,"threads_started":1}
I20260808 08:37:18.388371 22528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:18.387568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:60061)
0808 08:37:18.388090 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:18.388197 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":269,"threads_started":1}
I20260808 08:37:18.868026 22529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:18.867246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:37843)
0808 08:37:18.867751 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:18.867838 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":259,"threads_started":1}
I20260808 08:37:19.309999 22530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:19.309297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:38377)
0808 08:37:19.309739 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:19.309819 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":210,"threads_started":1}
I20260808 08:37:19.390318 22531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:19.389502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:34299)
0808 08:37:19.390047 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:19.390127 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":306,"threads_started":1}
I20260808 08:37:19.869756 22532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:19.868985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:58145)
0808 08:37:19.869497 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:19.869582 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":326,"threads_started":1}
I20260808 08:37:19.964708 22533 raft_consensus.cc:482] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:37:19.964923 22533 raft_consensus.cc:504] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } }
I20260808 08:37:19.965636 22533 leader_election.cc:288] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 267fe901cac445a2b2de1301232cbd0b (127.5.164.195:41819), 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967)
W20260808 08:37:19.966689 22107 leader_election.cc:341] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967): Not found: Tablet not found: e4bbc93d449d45269ddc05bf7cb71bb7
W20260808 08:37:19.966953 22106 leader_election.cc:341] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 267fe901cac445a2b2de1301232cbd0b (127.5.164.195:41819): Not found: Tablet not found: e4bbc93d449d45269ddc05bf7cb71bb7
I20260808 08:37:19.967075 22106 leader_election.cc:302] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a4ed1bbddb5409d97456cb459336bcb; no voters: 267fe901cac445a2b2de1301232cbd0b, 3ac12b45831d4a70baff01c33f338144
I20260808 08:37:19.967399 22533 raft_consensus.cc:2726] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:37:20.311790 22534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:20.310969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:49563)
0808 08:37:20.311534 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:20.311630 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":359,"threads_started":1}
I20260808 08:37:20.392400 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:20.391464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:38997)
0808 08:37:20.392091 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:20.392186 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":377,"threads_started":1}
I20260808 08:37:20.871757 22537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:20.870905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:58451)
0808 08:37:20.871462 (+ 557us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:20.871555 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":336,"threads_started":1}
I20260808 08:37:21.313445 22538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:21.312696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:37715)
0808 08:37:21.313176 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:21.313262 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":251,"threads_started":1}
I20260808 08:37:21.394024 22539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:21.393281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:52745)
0808 08:37:21.393734 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:21.393827 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":229,"threads_started":1}
I20260808 08:37:21.873644 22540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:21.872783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:40505)
0808 08:37:21.873351 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:21.873446 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":265,"threads_started":1}
I20260808 08:37:22.315368 22541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:22.314398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:57753)
0808 08:37:22.315018 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:22.315110 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":309,"threads_started":1}
I20260808 08:37:22.395850 22542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:22.394934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:56323)
0808 08:37:22.395522 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:22.395605 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":349,"threads_started":1}
I20260808 08:37:22.875622 22543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:22.874714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:33627)
0808 08:37:22.875344 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:22.875432 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":256,"threads_started":1}
I20260808 08:37:23.317029 22544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:23.316303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:37743)
0808 08:37:23.316751 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:23.316842 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":247,"threads_started":1}
I20260808 08:37:23.352685 22545 raft_consensus.cc:482] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:37:23.352900 22545 raft_consensus.cc:504] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } }
I20260808 08:37:23.353510 22545 leader_election.cc:288] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 267fe901cac445a2b2de1301232cbd0b (127.5.164.195:41819), 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967)
W20260808 08:37:23.354475 22106 leader_election.cc:341] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 267fe901cac445a2b2de1301232cbd0b (127.5.164.195:41819): Not found: Tablet not found: e4bbc93d449d45269ddc05bf7cb71bb7
W20260808 08:37:23.354663 22107 leader_election.cc:341] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967): Not found: Tablet not found: e4bbc93d449d45269ddc05bf7cb71bb7
I20260808 08:37:23.354842 22107 leader_election.cc:302] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a4ed1bbddb5409d97456cb459336bcb; no voters: 267fe901cac445a2b2de1301232cbd0b, 3ac12b45831d4a70baff01c33f338144
I20260808 08:37:23.355118 22545 raft_consensus.cc:2726] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:37:23.397666 22546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:23.396814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:42965)
0808 08:37:23.397339 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:23.397466 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":267,"threads_started":1}
I20260808 08:37:23.877369 22547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:23.876583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:60711)
0808 08:37:23.877084 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:23.877200 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":245,"threads_started":1}
I20260808 08:37:24.318776 22548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:24.317992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:39905)
0808 08:37:24.318540 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:24.318616 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":311,"threads_started":1}
I20260808 08:37:24.399461 22550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:24.398702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:43185)
0808 08:37:24.399207 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:24.399294 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":247,"threads_started":1}
I20260808 08:37:24.879070 22551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:24.878366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:54487)
0808 08:37:24.878810 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:24.878889 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":249,"threads_started":1}
I20260808 08:37:25.320461 22552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:25.319751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:42039)
0808 08:37:25.320194 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:25.320277 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":221,"threads_started":1}
I20260808 08:37:25.401175 22553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:25.400436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:42033)
0808 08:37:25.400895 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:25.400988 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":268,"threads_started":1}
I20260808 08:37:25.880841 22554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:25.880065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:38269)
0808 08:37:25.880568 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:25.880664 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":249,"threads_started":1}
I20260808 08:37:26.294524 22555 raft_consensus.cc:482] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:37:26.294739 22555 raft_consensus.cc:504] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "267fe901cac445a2b2de1301232cbd0b" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 41819 } } peers { permanent_uuid: "6a4ed1bbddb5409d97456cb459336bcb" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36049 } } peers { permanent_uuid: "3ac12b45831d4a70baff01c33f338144" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38967 } }
I20260808 08:37:26.295604 22555 leader_election.cc:288] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 267fe901cac445a2b2de1301232cbd0b (127.5.164.195:41819), 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967)
W20260808 08:37:26.296532 22107 leader_election.cc:341] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ac12b45831d4a70baff01c33f338144 (127.5.164.194:38967): Not found: Tablet not found: e4bbc93d449d45269ddc05bf7cb71bb7
W20260808 08:37:26.296705 22106 leader_election.cc:341] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 267fe901cac445a2b2de1301232cbd0b (127.5.164.195:41819): Not found: Tablet not found: e4bbc93d449d45269ddc05bf7cb71bb7
I20260808 08:37:26.296890 22106 leader_election.cc:302] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a4ed1bbddb5409d97456cb459336bcb; no voters: 267fe901cac445a2b2de1301232cbd0b, 3ac12b45831d4a70baff01c33f338144
I20260808 08:37:26.297152 22555 raft_consensus.cc:2726] T e4bbc93d449d45269ddc05bf7cb71bb7 P 6a4ed1bbddb5409d97456cb459336bcb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 08:37:26.322367 22556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:26.321544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:52821)
0808 08:37:26.322086 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:26.322187 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":259,"threads_started":1}
I20260808 08:37:26.402982 22557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:26.402179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:39155)
0808 08:37:26.402676 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:26.402777 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":248,"threads_started":1}
I20260808 08:37:26.882591 22558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:26.881822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:39351)
0808 08:37:26.882325 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:26.882413 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":276,"threads_started":1}
I20260808 08:37:27.324318 22559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:27.323510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:43061)
0808 08:37:27.324023 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:27.324135 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":274,"threads_started":1}
I20260808 08:37:27.404603 22560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:27.403908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:53895)
0808 08:37:27.404333 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:27.404424 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":224,"threads_started":1}
I20260808 08:37:27.884357 22561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:27.883580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:49161)
0808 08:37:27.884072 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:27.884191 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":275,"threads_started":1}
I20260808 08:37:28.326287 22562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:28.325396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:34995)
0808 08:37:28.325979 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:28.326109 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":299,"threads_started":1}
I20260808 08:37:28.406272 22563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:28.405494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:44959)
0808 08:37:28.405969 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:28.406050 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":245,"threads_started":1}
I20260808 08:37:28.886106 22564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:28.885254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:36177)
0808 08:37:28.885817 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:28.885899 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":310,"threads_started":1}
I20260808 08:37:29.328431 22565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:29.327488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:48445)
0808 08:37:29.328141 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:29.328233 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":325,"threads_started":1}
I20260808 08:37:29.408334 22566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:29.407565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:52495)
0808 08:37:29.408051 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:29.408144 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":259,"threads_started":1}
I20260808 08:37:29.888190 22567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:29.887419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:58369)
0808 08:37:29.887901 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:29.888013 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":238,"threads_started":1}
I20260808 08:37:30.318205 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 22049
I20260808 08:37:30.330474 22569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:30.329743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:56735)
0808 08:37:30.330201 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:30.330300 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":235,"threads_started":1}
I20260808 08:37:30.410274 22570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:30.409414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.193:51385)
0808 08:37:30.409981 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:30.410091 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":285,"threads_started":1}
I20260808 08:37:30.890213 22571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:30.889312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.194:52917)
0808 08:37:30.889912 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:30.890008 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":304,"threads_started":1}
I20260808 08:37:31.283341 22568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:30.319556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58168 (local address 127.5.164.193:36049)
0808 08:37:30.320158 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:30.320166 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:31.264068 (+943902us) server_negotiation.cc:407] Connection header received
0808 08:37:31.264179 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:31.264186 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:31.264452 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:31.264602 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:31.266084 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:31.267059 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:31.268338 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:31.268945 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:31.269053 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:31.277139 (+ 8086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:31.277166 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:31.277182 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:31.277226 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:31.280193 (+ 2967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:31.280953 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:31.280960 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:31.280963 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:31.281105 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:31.281540 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:31.281544 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:31.281546 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:31.281962 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:31.282249 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:31.282590 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 08:37:31.282923 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":268,"threads_started":1}
I20260808 08:37:31.284703 22219 generic_service.cc:196] Checking for leaks (request via RPC)
W20260808 08:37:31.320727 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 22049: Timed out: CheckLeaks RPC to 127.5.164.193:36049 timed out after 1.000s (SENT)
I20260808 08:37:31.320987 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 22049
I20260808 08:37:31.332502 22573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:31.331696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37351 (local address 127.5.164.195:46035)
0808 08:37:31.332225 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:31.332320 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:37351: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":253,"threads_started":1}
I20260808 08:37:31.341377 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 22229
I20260808 08:37:31.356040 22574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:31.342356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38738 (local address 127.5.164.194:38967)
0808 08:37:31.343040 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:31.343044 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:31.343063 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:37:31.343119 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:31.343131 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:31.343258 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:31.343358 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:31.344758 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:31.345566 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:31.346915 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:31.347446 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:31.347549 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:31.350255 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:31.350261 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:31.350265 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:31.350301 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:31.353164 (+ 2863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:31.354001 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:31.354005 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:31.354008 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:31.354173 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:31.354617 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:31.354620 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:31.354622 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:31.354919 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:31.355243 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:31.355539 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 08:37:31.355729 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":418,"threads_started":1}
I20260808 08:37:31.356817 22363 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:31.443110 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 22229
I20260808 08:37:31.465602 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 22372
I20260808 08:37:31.479671 22576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:31.466402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57480 (local address 127.5.164.195:41819)
0808 08:37:31.466993 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:31.466998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:31.467018 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:37:31.467077 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:31.467081 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:31.467210 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:31.467310 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:31.468733 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:31.469556 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:31.471264 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:31.471719 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:31.471832 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:31.474434 (+ 2602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:31.474439 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:31.474442 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:31.474476 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:31.477080 (+ 2604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:31.477701 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:31.477705 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:31.477707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:31.477864 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:31.478195 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:31.478199 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:31.478201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:31.478476 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:31.478692 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:31.478922 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 08:37:31.479100 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":299,"threads_started":1}
I20260808 08:37:31.480392 22504 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:31.565196 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 22372
2026-08-08T08:37:31Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (26087 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:37:31 dist-test-slave-chsk krb5kdc[22580](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:37:31 dist-test-slave-chsk krb5kdc[22580](info): set up 2 sockets
Aug 08 08:37:31 dist-test-slave-chsk krb5kdc[22580](info): commencing operation
krb5kdc: starting...
W20260808 08:37:32.747748 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.009s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:37:32 dist-test-slave-chsk krb5kdc[22580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:37:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:37:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:37:33.053324 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:40677
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:34925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:40677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:37:33.398136 22594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:33.398432 22594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:33.398614 22594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:33.406064 22594 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 08:37:33.406219 22594 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 08:37:33.406258 22594 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 08:37:33.406304 22594 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:37:33.406391 22594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:33.406497 22594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:33.406580 22594 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:37:33.406683 22594 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:37:33.417270 22594 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:40677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:40677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:33.418699 22594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:33.420150 22594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:33.433147 22600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:33.433353 22601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:33.433313 22603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:33.434321 22594 server_base.cc:1034] running on GCE node
I20260808 08:37:33.435206 22594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:33.436755 22594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:33.437999 22594 hybrid_clock.cc:648] HybridClock initialized: now 1786178253437937 us; error 30 us; skew 500 ppm
I20260808 08:37:33.438374 22594 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:33 dist-test-slave-chsk krb5kdc[22580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178253, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:33.447281 22594 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:37:33.448974 22594 webserver.cc:460] Webserver started at http://127.5.164.254:33499/ using document root <none> and password file <none>
I20260808 08:37:33.449685 22594 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:33.449777 22594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:33.450067 22594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:37:33.453227 22594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "d7848aeef22e4e359244074d6866d4cb"
format_stamp: "Formatted at 2026-08-08 08:37:33 on dist-test-slave-chsk"
server_key: "7899fd9ed1db9b84a3f8490ad8080a92"
server_key_iv: "8d1d5508a3f2c0cc714475ddafb6f6d8"
server_key_version: "encryptionkey@0"
I20260808 08:37:33.453979 22594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "d7848aeef22e4e359244074d6866d4cb"
format_stamp: "Formatted at 2026-08-08 08:37:33 on dist-test-slave-chsk"
server_key: "7899fd9ed1db9b84a3f8490ad8080a92"
server_key_iv: "8d1d5508a3f2c0cc714475ddafb6f6d8"
server_key_version: "encryptionkey@0"
I20260808 08:37:33.459408 22594 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260808 08:37:33.462743 22611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:33.464109 22594 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:37:33.464294 22594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "d7848aeef22e4e359244074d6866d4cb"
format_stamp: "Formatted at 2026-08-08 08:37:33 on dist-test-slave-chsk"
server_key: "7899fd9ed1db9b84a3f8490ad8080a92"
server_key_iv: "8d1d5508a3f2c0cc714475ddafb6f6d8"
server_key_version: "encryptionkey@0"
I20260808 08:37:33.464516 22594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:33.479841 22594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:33.484361 22594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:33.484659 22594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:33.505220 22594 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:40677
I20260808 08:37:33.505241 22663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:40677 every 8 connection(s)
I20260808 08:37:33.506703 22594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:37:33.510578 22665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:33.514302 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 22594
I20260808 08:37:33.514546 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:37:33.515440 5779 external_mini_cluster.cc:1428] Setting key 52b3d7b4fbf1b1ae89d26320f22220b8
I20260808 08:37:33.524046 22665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Bootstrap starting.
I20260808 08:37:33.527299 22665 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:33.528360 22665 log.cc:824] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Log is configured to *not* fsync() on all Append() calls
Aug 08 08:37:33 dist-test-slave-chsk krb5kdc[22580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:33.531363 22665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: No bootstrap required, opened a new log
I20260808 08:37:33.539279 22668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:33.517831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47410 (local address 127.5.164.254:40677)
0808 08:37:33.518658 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:33.518670 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:33.518718 (+ 48us) server_negotiation.cc:407] Connection header received
0808 08:37:33.520511 (+ 1793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:33.520536 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:33.520999 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:33.521437 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:33.523066 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:33.524548 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:33.526065 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:33.526740 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:33.526936 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:33.531316 (+ 4380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:33.531324 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:33.531339 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:33.531379 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:33.534737 (+ 3358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:33.535596 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:33.535604 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:33.535611 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:33.535798 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:33.536211 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:33.536217 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:33.536221 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:33.536822 (+ 601us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:33.537173 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:33.537676 (+ 503us) server_negotiation.cc:299] Negotiation successful
0808 08:37:33.538172 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":401,"threads_started":1}
I20260808 08:37:33.539532 22665 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } }
I20260808 08:37:33.540035 22665 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:33.540154 22665 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7848aeef22e4e359244074d6866d4cb, State: Initialized, Role: FOLLOWER
I20260808 08:37:33.540782 22665 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } }
I20260808 08:37:33.541054 22665 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:37:33.541217 22665 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:37:33.541399 22665 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:33.544003 22665 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } }
I20260808 08:37:33.544487 22665 leader_election.cc:302] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7848aeef22e4e359244074d6866d4cb; no voters:
I20260808 08:37:33.545157 22665 leader_election.cc:288] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:37:33.545346 22670 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:37:33.546190 22670 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 1 LEADER]: Becoming Leader. State: Replica: d7848aeef22e4e359244074d6866d4cb, State: Running, Role: LEADER
I20260808 08:37:33.546840 22670 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } }
I20260808 08:37:33.547434 22665 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:37:33.549655 22671 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7848aeef22e4e359244074d6866d4cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } } }
I20260808 08:37:33.551209 22671 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [sys.catalog]: This master's current role is: LEADER
I20260808 08:37:33.549594 22672 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7848aeef22e4e359244074d6866d4cb. Latest consensus state: current_term: 1 leader_uuid: "d7848aeef22e4e359244074d6866d4cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } } }
I20260808 08:37:33.551795 22672 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [sys.catalog]: This master's current role is: LEADER
I20260808 08:37:33.557916 22677 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:37:33.564747 22677 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:37:33.589396 22690 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 08:37:33.590134 22677 catalog_manager.cc:1347] Generated new cluster ID: 4f3b128aeded4c1dad8e1df89461a493
I20260808 08:37:33.590317 22677 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:37:33.622200 22677 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:37:33.624195 22677 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:37:33.631834 22677 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Generated new TSK 0
I20260808 08:37:33.632846 22677 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:37:33.718638 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:40677
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:34925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:37:34.086921 22694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:34.087314 22694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:34.087491 22694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:34.094957 22694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:34.095172 22694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:34.095378 22694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:37:34.105741 22694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:40677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:34.107244 22694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:34.108652 22694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:34.122177 22702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:34.122273 22699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:34.122133 22700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:34.123404 22694 server_base.cc:1034] running on GCE node
I20260808 08:37:34.124033 22694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:34.124991 22694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:34.126240 22694 hybrid_clock.cc:648] HybridClock initialized: now 1786178254126171 us; error 39 us; skew 500 ppm
I20260808 08:37:34.126577 22694 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:34 dist-test-slave-chsk krb5kdc[22580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178254, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:34.129805 22694 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:37:34.131275 22694 webserver.cc:460] Webserver started at http://127.5.164.193:43223/ using document root <none> and password file <none>
I20260808 08:37:34.131982 22694 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:34.132134 22694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:34.132473 22694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:37:34.135452 22694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e"
format_stamp: "Formatted at 2026-08-08 08:37:34 on dist-test-slave-chsk"
server_key: "61b456076e8c5485a14254c530903d25"
server_key_iv: "44b917422924b0c5ebed64d9d08d3d0c"
server_key_version: "encryptionkey@0"
I20260808 08:37:34.136324 22694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e"
format_stamp: "Formatted at 2026-08-08 08:37:34 on dist-test-slave-chsk"
server_key: "61b456076e8c5485a14254c530903d25"
server_key_iv: "44b917422924b0c5ebed64d9d08d3d0c"
server_key_version: "encryptionkey@0"
I20260808 08:37:34.141598 22694 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260808 08:37:34.145049 22712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:34.146448 22694 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:37:34.146627 22694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e"
format_stamp: "Formatted at 2026-08-08 08:37:34 on dist-test-slave-chsk"
server_key: "61b456076e8c5485a14254c530903d25"
server_key_iv: "44b917422924b0c5ebed64d9d08d3d0c"
server_key_version: "encryptionkey@0"
I20260808 08:37:34.146840 22694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:34.164252 22694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:34.168609 22694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:34.168931 22694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:34.169992 22694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:37:34.171412 22694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:37:34.171518 22694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:34.171672 22694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:37:34.171751 22694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:34.206516 22694 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:42945
I20260808 08:37:34.206566 22831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:42945 every 8 connection(s)
I20260808 08:37:34.207847 22694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:37:34.217559 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 22694
I20260808 08:37:34.217796 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:37:34.218534 5779 external_mini_cluster.cc:1428] Setting key 4b9e7c2d44a67eaf8b687eef1aba170f
Aug 08 08:37:34 dist-test-slave-chsk krb5kdc[22580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178254, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:34.229460 22834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:34.210394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:38909 (local address 127.5.164.254:40677)
0808 08:37:34.210880 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:34.210886 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:34.211890 (+ 1004us) server_negotiation.cc:407] Connection header received
0808 08:37:34.213637 (+ 1747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:34.213641 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:34.213717 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:34.213818 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:34.215388 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:34.216127 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:34.218017 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:34.218414 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:34.218506 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:34.222269 (+ 3763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:34.222278 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:34.222286 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:34.222331 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:34.225957 (+ 3626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:34.226702 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:34.226710 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:34.226717 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:34.226872 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:34.227366 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:34.227373 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:34.227380 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:34.227765 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:34.227924 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:34.228671 (+ 747us) server_negotiation.cc:299] Negotiation successful
0808 08:37:34.228942 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":216,"threads_started":1}
I20260808 08:37:34.230037 22835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:34.210972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:38909)
0808 08:37:34.211719 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:34.211757 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:34.213388 (+ 1631us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:34.214054 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:34.214062 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:34.214581 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:34.215218 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:34.215239 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:34.216271 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:34.216275 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:34.217842 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:34.217859 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:34.218669 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:34.218678 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:34.218970 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:34.219751 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:34.219773 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:34.222006 (+ 2233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:34.226107 (+ 4101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:34.226115 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:34.226130 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:34.226569 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:34.226987 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:34.226989 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:34.226992 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:34.227242 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:34.227915 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:34.227922 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:34.228273 (+ 351us) client_negotiation.cc:769] Sending connection context
0808 08:37:34.228514 (+ 241us) client_negotiation.cc:240] Negotiation successful
0808 08:37:34.228913 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":308,"threads_started":1}
I20260808 08:37:34.231679 22832 heartbeater.cc:347] Connected to a master server at 127.5.164.254:40677
I20260808 08:37:34.232003 22832 heartbeater.cc:464] Registering TS with master...
I20260808 08:37:34.232748 22832 heartbeater.cc:511] Master 127.5.164.254:40677 requested a full tablet report, sending...
I20260808 08:37:34.235074 22629 ts_manager.cc:194] Registered new tserver with Master: b81c4c1dae4b4fb3ace6ae2231a6847e (127.5.164.193:42945)
I20260808 08:37:34.236603 22629 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:38909
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:37:34.286679 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:40677
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:34925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:37:34.636914 22838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:34.637267 22838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:34.637444 22838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:34.645114 22838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:34.645290 22838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:34.645467 22838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:37:34.657112 22838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:40677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:34.658507 22838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:34.659946 22838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:34.673441 22845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:34.673409 22847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:34.673671 22844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:34.674279 22838 server_base.cc:1034] running on GCE node
I20260808 08:37:34.674849 22838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:34.675840 22838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:34.677044 22838 hybrid_clock.cc:648] HybridClock initialized: now 1786178254676998 us; error 46 us; skew 500 ppm
I20260808 08:37:34.677386 22838 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:34 dist-test-slave-chsk krb5kdc[22580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178254, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:34.680694 22838 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:37:34.682278 22838 webserver.cc:460] Webserver started at http://127.5.164.194:45989/ using document root <none> and password file <none>
I20260808 08:37:34.682979 22838 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:34.683121 22838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:34.683529 22838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:37:34.686638 22838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "e416d9c2c9a44e79b0b044c3d4c98899"
format_stamp: "Formatted at 2026-08-08 08:37:34 on dist-test-slave-chsk"
server_key: "b1109108938d992fedee5a37e80eb81c"
server_key_iv: "d1d786d8b6ccd208c658a50f4ba5499c"
server_key_version: "encryptionkey@0"
I20260808 08:37:34.687485 22838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "e416d9c2c9a44e79b0b044c3d4c98899"
format_stamp: "Formatted at 2026-08-08 08:37:34 on dist-test-slave-chsk"
server_key: "b1109108938d992fedee5a37e80eb81c"
server_key_iv: "d1d786d8b6ccd208c658a50f4ba5499c"
server_key_version: "encryptionkey@0"
I20260808 08:37:34.692896 22838 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260808 08:37:34.696578 22854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:34.697952 22838 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:37:34.698146 22838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "e416d9c2c9a44e79b0b044c3d4c98899"
format_stamp: "Formatted at 2026-08-08 08:37:34 on dist-test-slave-chsk"
server_key: "b1109108938d992fedee5a37e80eb81c"
server_key_iv: "d1d786d8b6ccd208c658a50f4ba5499c"
server_key_version: "encryptionkey@0"
I20260808 08:37:34.698385 22838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:34.717170 22838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:34.721645 22838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:34.721971 22838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:34.723069 22838 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:37:34.724557 22838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:37:34.724669 22838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:34.724831 22838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:37:34.724907 22838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:34.760335 22838 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:38599
I20260808 08:37:34.760381 22972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:38599 every 8 connection(s)
I20260808 08:37:34.761698 22838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:37:34.768424 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 22838
I20260808 08:37:34.768649 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:37:34.769236 5779 external_mini_cluster.cc:1428] Setting key 9b3abb22b9a7b305c7c4701dc2249236
Aug 08 08:37:34 dist-test-slave-chsk krb5kdc[22580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178254, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:34.784242 22975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:34.764411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:41667 (local address 127.5.164.254:40677)
0808 08:37:34.764869 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:34.764874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:34.765835 (+ 961us) server_negotiation.cc:407] Connection header received
0808 08:37:34.767780 (+ 1945us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:34.767785 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:34.767869 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:34.768000 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:34.770056 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:34.771131 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:34.773561 (+ 2430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:34.774000 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:34.774094 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:34.778424 (+ 4330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:34.778429 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:34.778432 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:34.778465 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:34.781085 (+ 2620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:34.781815 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:34.781823 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:34.781829 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:34.781967 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:34.782412 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:34.782418 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:34.782421 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:34.782687 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:34.782848 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:34.783610 (+ 762us) server_negotiation.cc:299] Negotiation successful
0808 08:37:34.783841 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":238,"threads_started":1}
I20260808 08:37:34.785228 22976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:34.764993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:41667)
0808 08:37:34.765674 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:34.765712 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:34.767532 (+ 1820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:34.768300 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:34.768311 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:34.769077 (+ 766us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:34.769860 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:34.769888 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:34.771302 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:34.771307 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:34.773392 (+ 2085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:34.773410 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:34.774240 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:34.774250 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:34.774577 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:34.775399 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:34.775439 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:34.778184 (+ 2745us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:34.781230 (+ 3046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:34.781242 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:34.781258 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:34.781685 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:34.782093 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:34.782098 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:34.782102 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:34.782299 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:34.782818 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:34.782826 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:34.783253 (+ 427us) client_negotiation.cc:769] Sending connection context
0808 08:37:34.783532 (+ 279us) client_negotiation.cc:240] Negotiation successful
0808 08:37:34.784081 (+ 549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":260,"threads_started":1}
I20260808 08:37:34.786778 22973 heartbeater.cc:347] Connected to a master server at 127.5.164.254:40677
I20260808 08:37:34.787120 22973 heartbeater.cc:464] Registering TS with master...
I20260808 08:37:34.788105 22973 heartbeater.cc:511] Master 127.5.164.254:40677 requested a full tablet report, sending...
I20260808 08:37:34.789798 22629 ts_manager.cc:194] Registered new tserver with Master: e416d9c2c9a44e79b0b044c3d4c98899 (127.5.164.194:38599)
I20260808 08:37:34.791196 22629 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:41667
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:37:34.838261 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:40677
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:34925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:37:35.182113 22980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:35.182498 22980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:35.182627 22980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:35.190088 22980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:35.190212 22980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:35.190330 22980 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:37:35.200719 22980 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:40677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:35.202075 22980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:35.203521 22980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:35.218396 22985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:35.218501 22988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:35.218921 22986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:35.219539 22980 server_base.cc:1034] running on GCE node
I20260808 08:37:35.220240 22980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:35.221226 22980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:35.222462 22980 hybrid_clock.cc:648] HybridClock initialized: now 1786178255222398 us; error 64 us; skew 500 ppm
I20260808 08:37:35.222819 22980 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:35 dist-test-slave-chsk krb5kdc[22580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178255, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:35.225978 22980 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:37:35.227461 22980 webserver.cc:460] Webserver started at http://127.5.164.195:40021/ using document root <none> and password file <none>
I20260808 08:37:35.228158 22980 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:35.228312 22980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:35.228652 22980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:37:35.231920 22980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "0ea795e458944e1bb680d3d04eff986d"
format_stamp: "Formatted at 2026-08-08 08:37:35 on dist-test-slave-chsk"
server_key: "1e3a92ce157953d7c2d2de93463a16e3"
server_key_iv: "0d0b2e1db1ed42da90659fd1589fe80e"
server_key_version: "encryptionkey@0"
I20260808 08:37:35.232745 22980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "0ea795e458944e1bb680d3d04eff986d"
format_stamp: "Formatted at 2026-08-08 08:37:35 on dist-test-slave-chsk"
server_key: "1e3a92ce157953d7c2d2de93463a16e3"
server_key_iv: "0d0b2e1db1ed42da90659fd1589fe80e"
server_key_version: "encryptionkey@0"
I20260808 08:37:35.238454 22980 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:37:35.239696 22832 heartbeater.cc:503] Master 127.5.164.254:40677 was elected leader, sending a full tablet report...
I20260808 08:37:35.242627 22995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:35.244120 22980 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 08:37:35.244272 22980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "0ea795e458944e1bb680d3d04eff986d"
format_stamp: "Formatted at 2026-08-08 08:37:35 on dist-test-slave-chsk"
server_key: "1e3a92ce157953d7c2d2de93463a16e3"
server_key_iv: "0d0b2e1db1ed42da90659fd1589fe80e"
server_key_version: "encryptionkey@0"
I20260808 08:37:35.244457 22980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:35.259229 22980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:35.263264 22980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:35.263576 22980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:35.264505 22980 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:37:35.265760 22980 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:37:35.265832 22980 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:35.265918 22980 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:37:35.265966 22980 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:35.300133 22980 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:35677
I20260808 08:37:35.300160 23112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:35677 every 8 connection(s)
I20260808 08:37:35.301491 22980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:37:35.310402 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 22980
I20260808 08:37:35.310597 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:37:35.311065 5779 external_mini_cluster.cc:1428] Setting key 3410b8e43f5379fde8f8f4b96c103cc9
Aug 08 08:37:35 dist-test-slave-chsk krb5kdc[22580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178255, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:35.321861 23115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.304447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:55069 (local address 127.5.164.254:40677)
0808 08:37:35.304952 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:35.304957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:35.305635 (+ 678us) server_negotiation.cc:407] Connection header received
0808 08:37:35.307676 (+ 2041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:35.307683 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:35.307771 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:35.307892 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:35.309385 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.310194 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.311939 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.312478 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.312617 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.316211 (+ 3594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:35.316217 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:35.316220 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:35.316253 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:35.318709 (+ 2456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:35.319513 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:35.319520 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:35.319528 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:35.319651 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:35.320106 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:35.320110 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:35.320112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:35.320371 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:35.320544 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:35.321225 (+ 681us) server_negotiation.cc:299] Negotiation successful
0808 08:37:35.321467 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":277,"threads_started":1}
I20260808 08:37:35.322811 23116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.304752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:55069)
0808 08:37:35.305455 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:35.305494 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:35.307392 (+ 1898us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:35.308129 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:35.308137 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:35.308645 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:35.309201 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:35.309218 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.310357 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.310368 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:35.311778 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:35.311791 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.312711 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.312718 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:35.312950 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.313653 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:35.313682 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:35.315987 (+ 2305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:35.318857 (+ 2870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:35.318866 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:35.318881 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:35.319383 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:35.319774 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:35.319779 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:35.319783 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:35.319971 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:35.320507 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:35.320515 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:35.320855 (+ 340us) client_negotiation.cc:769] Sending connection context
0808 08:37:35.321114 (+ 259us) client_negotiation.cc:240] Negotiation successful
0808 08:37:35.321655 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":286,"threads_started":1}
I20260808 08:37:35.324211 23113 heartbeater.cc:347] Connected to a master server at 127.5.164.254:40677
I20260808 08:37:35.324536 23113 heartbeater.cc:464] Registering TS with master...
I20260808 08:37:35.325402 23113 heartbeater.cc:511] Master 127.5.164.254:40677 requested a full tablet report, sending...
I20260808 08:37:35.326961 22629 ts_manager.cc:194] Registered new tserver with Master: 0ea795e458944e1bb680d3d04eff986d (127.5.164.195:35677)
I20260808 08:37:35.327831 22629 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:55069
I20260808 08:37:35.338896 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:37:35.356220 23115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.343583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47416 (local address 127.5.164.254:40677)
0808 08:37:35.343812 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:35.343823 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:35.344169 (+ 346us) server_negotiation.cc:407] Connection header received
0808 08:37:35.344302 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:35.344305 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:35.344369 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:35.344451 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:35.345888 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.346606 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.348265 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.348761 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.348901 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.351298 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:35.351306 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:35.351313 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:35.351351 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:35.353764 (+ 2413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:35.354402 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:35.354406 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:35.354408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:35.354527 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:35.354860 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:35.354863 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:35.354865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:35.355242 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:35.355430 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:35.355703 (+ 273us) server_negotiation.cc:299] Negotiation successful
0808 08:37:35.355870 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:37:35.360278 22629 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47416:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:37:35.367563 22629 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:37:35.405218 23128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.380011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59304 (local address 127.5.164.193:42945)
0808 08:37:35.395480 (+ 15469us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:35.395495 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:35.395537 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:37:35.395695 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:35.395708 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:35.396037 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:35.396291 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:35.397580 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.399107 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.402058 (+ 2951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.404027 (+ 1969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.404176 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.404432 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:35.404711 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 08:37:35.404881 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15227,"thread_start_us":16983,"threads_started":1}
I20260808 08:37:35.405232 23127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.379822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42945 (local address 127.0.0.1:59304)
0808 08:37:35.394545 (+ 14723us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:35.394622 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:35.394853 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:35.396865 (+ 2012us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:35.396875 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:35.396917 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:35.397367 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:35.397380 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.399332 (+ 1952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.399341 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:35.401867 (+ 2526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:35.401886 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.404239 (+ 2353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.404245 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:35.404464 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.404521 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 08:37:35.404662 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 08:37:35.404855 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14376,"thread_start_us":15249,"threads_started":1}
I20260808 08:37:35.406667 23129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.381986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:35677 (local address 127.0.0.1:56446)
0808 08:37:35.398230 (+ 16244us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:35.398250 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:35.398376 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:35.399235 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:35.399239 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:35.399256 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:35.399808 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:35.399824 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.401378 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.401381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:35.403636 (+ 2255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:35.403650 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.405868 (+ 2218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.405876 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:35.406060 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.406098 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 08:37:35.406193 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 08:37:35.406290 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16084,"mutex_wait_us":1,"thread_start_us":15689,"threads_started":1}
I20260808 08:37:35.407127 23130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.380332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34176 (local address 127.5.164.194:38599)
0808 08:37:35.396985 (+ 16653us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:35.396996 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:35.398235 (+ 1239us) server_negotiation.cc:407] Connection header received
0808 08:37:35.398493 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:35.398502 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:35.398733 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:35.398939 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:35.400436 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.401947 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.404314 (+ 2367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.405776 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.405911 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.406097 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:35.406575 (+ 478us) server_negotiation.cc:299] Negotiation successful
0808 08:37:35.406766 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16515,"thread_start_us":16440,"threads_started":1}
I20260808 08:37:35.408061 23132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.382760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56446 (local address 127.5.164.195:35677)
0808 08:37:35.397627 (+ 14867us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:35.397635 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:35.398354 (+ 719us) server_negotiation.cc:407] Connection header received
0808 08:37:35.398538 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:35.398545 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:35.398730 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:35.398940 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:35.400084 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.401227 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.403858 (+ 2631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.405338 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.405476 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.405717 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:35.406995 (+ 1278us) server_negotiation.cc:299] Negotiation successful
0808 08:37:35.407682 (+ 687us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14664,"thread_start_us":14529,"threads_started":1}
I20260808 08:37:35.409610 22762 tablet_service.cc:1467] Processing CreateTablet for tablet f295f3a1a6b14a90a414e24955046d1d (DEFAULT_TABLE table=test-table [id=5f41da1d7b1641b5b7f1a0b39982ae18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:37:35.410898 22762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f295f3a1a6b14a90a414e24955046d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:35.410898 23045 tablet_service.cc:1467] Processing CreateTablet for tablet f295f3a1a6b14a90a414e24955046d1d (DEFAULT_TABLE table=test-table [id=5f41da1d7b1641b5b7f1a0b39982ae18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:37:35.412421 23045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f295f3a1a6b14a90a414e24955046d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:35.419555 23131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.379977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:38599 (local address 127.0.0.1:34176)
0808 08:37:35.398087 (+ 18110us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:35.398112 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:35.398249 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:35.399208 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:35.399214 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:35.399240 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:35.400249 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:35.400262 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.402182 (+ 1920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.402186 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:35.404104 (+ 1918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:35.404129 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.406192 (+ 2063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.406199 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:35.406358 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.406393 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 08:37:35.406482 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 08:37:35.406634 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17958,"thread_start_us":17954,"threads_started":1}
I20260808 08:37:35.423187 23133 tablet_bootstrap.cc:492] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e: Bootstrap starting.
I20260808 08:37:35.423774 22906 tablet_service.cc:1467] Processing CreateTablet for tablet f295f3a1a6b14a90a414e24955046d1d (DEFAULT_TABLE table=test-table [id=5f41da1d7b1641b5b7f1a0b39982ae18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:37:35.424971 23134 tablet_bootstrap.cc:492] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d: Bootstrap starting.
I20260808 08:37:35.425954 22906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f295f3a1a6b14a90a414e24955046d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:35.427416 23133 tablet_bootstrap.cc:654] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:35.428426 23134 tablet_bootstrap.cc:654] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:35.428464 23133 log.cc:824] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:35.429591 23134 log.cc:824] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:35.431486 23133 tablet_bootstrap.cc:492] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e: No bootstrap required, opened a new log
I20260808 08:37:35.431764 23133 ts_tablet_manager.cc:1397] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 08:37:35.432585 23134 tablet_bootstrap.cc:492] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d: No bootstrap required, opened a new log
I20260808 08:37:35.432838 23134 ts_tablet_manager.cc:1397] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260808 08:37:35.439479 23133 raft_consensus.cc:348] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } }
I20260808 08:37:35.439865 23133 raft_consensus.cc:374] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:35.439989 23133 raft_consensus.cc:729] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c4c1dae4b4fb3ace6ae2231a6847e, State: Initialized, Role: FOLLOWER
I20260808 08:37:35.440657 23133 consensus_queue.cc:260] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } }
I20260808 08:37:35.442538 23133 ts_tablet_manager.cc:1428] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20260808 08:37:35.444677 23137 tablet_bootstrap.cc:492] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899: Bootstrap starting.
I20260808 08:37:35.444491 23134 raft_consensus.cc:348] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } }
I20260808 08:37:35.444907 23134 raft_consensus.cc:374] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:35.445008 23134 raft_consensus.cc:729] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea795e458944e1bb680d3d04eff986d, State: Initialized, Role: FOLLOWER
I20260808 08:37:35.445719 23134 consensus_queue.cc:260] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } }
I20260808 08:37:35.446808 23113 heartbeater.cc:503] Master 127.5.164.254:40677 was elected leader, sending a full tablet report...
I20260808 08:37:35.447486 23134 ts_tablet_manager.cc:1428] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d: Time spent starting tablet: real 0.015s user 0.013s sys 0.003s
I20260808 08:37:35.449034 23137 tablet_bootstrap.cc:654] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:35.449635 23139 raft_consensus.cc:482] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:37:35.449918 23139 raft_consensus.cc:504] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } }
I20260808 08:37:35.450348 23137 log.cc:824] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:35.451942 23139 leader_election.cc:288] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b81c4c1dae4b4fb3ace6ae2231a6847e (127.5.164.193:42945), e416d9c2c9a44e79b0b044c3d4c98899 (127.5.164.194:38599)
I20260808 08:37:35.454223 23137 tablet_bootstrap.cc:492] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899: No bootstrap required, opened a new log
I20260808 08:37:35.454520 23137 ts_tablet_manager.cc:1397] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260808 08:37:35.459484 23130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.452611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:56501 (local address 127.5.164.194:38599)
0808 08:37:35.452806 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:35.452813 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:35.453548 (+ 735us) server_negotiation.cc:407] Connection header received
0808 08:37:35.453808 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:35.453813 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:35.453881 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:35.453944 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:35.454765 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.455843 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.457622 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.458501 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.458690 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.458767 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:35.459051 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 08:37:35.459217 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 08:37:35.459582 23142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.452379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:38599 (local address 127.5.164.195:56501)
0808 08:37:35.453448 (+ 1069us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:35.453467 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:35.453652 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:35.454136 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:35.454140 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:35.454159 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:35.454560 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:35.454581 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.455994 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.455997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:35.457465 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:35.457478 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.458700 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.458706 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:35.458884 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.458907 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:37:35.459012 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 08:37:35.459142 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":959,"mutex_wait_us":343,"thread_start_us":413,"threads_started":1}
W20260808 08:37:35.460269 22833 tablet.cc:2369] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:37:35.460640 22926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f295f3a1a6b14a90a414e24955046d1d" candidate_uuid: "0ea795e458944e1bb680d3d04eff986d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" is_pre_election: true
I20260808 08:37:35.461336 23116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.452374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42945 (local address 127.5.164.195:34855)
0808 08:37:35.452833 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:35.452851 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:35.452963 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:35.453943 (+ 980us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:35.453948 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:35.453970 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:35.454180 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:35.454194 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.455765 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.455770 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:35.457912 (+ 2142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:35.457932 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.459899 (+ 1967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.459905 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:35.460128 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.460163 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 08:37:35.460246 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 08:37:35.460376 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":31}
I20260808 08:37:35.461606 23128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.453322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:34855 (local address 127.5.164.193:42945)
0808 08:37:35.453517 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:35.453525 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:35.453544 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:37:35.453614 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:35.453620 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:35.453695 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:35.453783 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:35.454373 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.455605 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.458126 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.459446 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.460526 (+ 1080us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.460602 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:35.460657 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 08:37:35.460782 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 08:37:35.461936 22997 leader_election.cc:341] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e416d9c2c9a44e79b0b044c3d4c98899 (127.5.164.194:38599): Illegal state: must be running to vote when last-logged opid is not known
I20260808 08:37:35.462743 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f295f3a1a6b14a90a414e24955046d1d" candidate_uuid: "0ea795e458944e1bb680d3d04eff986d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" is_pre_election: true
I20260808 08:37:35.463253 22782 raft_consensus.cc:2454] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ea795e458944e1bb680d3d04eff986d in term 0.
I20260808 08:37:35.463892 22999 leader_election.cc:302] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ea795e458944e1bb680d3d04eff986d, b81c4c1dae4b4fb3ace6ae2231a6847e; no voters: e416d9c2c9a44e79b0b044c3d4c98899
I20260808 08:37:35.464258 23139 raft_consensus.cc:2781] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:37:35.464403 23139 raft_consensus.cc:482] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:37:35.464512 23139 raft_consensus.cc:3037] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:35.465040 23137 raft_consensus.cc:348] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } }
I20260808 08:37:35.465377 23137 raft_consensus.cc:374] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:35.465497 23137 raft_consensus.cc:729] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e416d9c2c9a44e79b0b044c3d4c98899, State: Initialized, Role: FOLLOWER
I20260808 08:37:35.466156 23137 consensus_queue.cc:260] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } }
I20260808 08:37:35.467314 22973 heartbeater.cc:503] Master 127.5.164.254:40677 was elected leader, sending a full tablet report...
I20260808 08:37:35.467325 23139 raft_consensus.cc:504] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } }
I20260808 08:37:35.468122 23139 leader_election.cc:288] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [CANDIDATE]: Term 1 election: Requested vote from peers b81c4c1dae4b4fb3ace6ae2231a6847e (127.5.164.193:42945), e416d9c2c9a44e79b0b044c3d4c98899 (127.5.164.194:38599)
I20260808 08:37:35.468583 22782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f295f3a1a6b14a90a414e24955046d1d" candidate_uuid: "0ea795e458944e1bb680d3d04eff986d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e"
I20260808 08:37:35.468634 22926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f295f3a1a6b14a90a414e24955046d1d" candidate_uuid: "0ea795e458944e1bb680d3d04eff986d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e416d9c2c9a44e79b0b044c3d4c98899"
I20260808 08:37:35.468811 22782 raft_consensus.cc:3037] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:35.468887 22926 raft_consensus.cc:3037] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:35.469578 23137 ts_tablet_manager.cc:1428] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260808 08:37:35.471611 22782 raft_consensus.cc:2454] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ea795e458944e1bb680d3d04eff986d in term 1.
I20260808 08:37:35.472076 22926 raft_consensus.cc:2454] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ea795e458944e1bb680d3d04eff986d in term 1.
I20260808 08:37:35.472081 22999 leader_election.cc:302] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ea795e458944e1bb680d3d04eff986d, b81c4c1dae4b4fb3ace6ae2231a6847e; no voters:
I20260808 08:37:35.472594 23139 raft_consensus.cc:2781] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:37:35.473157 23139 raft_consensus.cc:686] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [term 1 LEADER]: Becoming Leader. State: Replica: 0ea795e458944e1bb680d3d04eff986d, State: Running, Role: LEADER
I20260808 08:37:35.473667 23139 consensus_queue.cc:237] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } }
I20260808 08:37:35.478160 22628 catalog_manager.cc:5495] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ea795e458944e1bb680d3d04eff986d (127.5.164.195). New cstate: current_term: 1 leader_uuid: "0ea795e458944e1bb680d3d04eff986d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } health_report { overall_health: HEALTHY } } }
I20260808 08:37:35.495770 23132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.490318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56452 (local address 127.5.164.195:35677)
0808 08:37:35.490527 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:35.490533 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:35.490552 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:37:35.490825 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:35.490832 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:35.490937 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:35.491109 (+ 172us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:37:35.491520 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.492250 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.493701 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.494086 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.494186 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.494663 (+ 477us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:37:35.495193 (+ 530us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:37:35.495300 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:35.495389 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 08:37:35.495459 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:37:35.503854 22926 raft_consensus.cc:1261] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899 [term 1 FOLLOWER]: Refusing update from remote peer 0ea795e458944e1bb680d3d04eff986d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:37:35.503935 22782 raft_consensus.cc:1261] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e [term 1 FOLLOWER]: Refusing update from remote peer 0ea795e458944e1bb680d3d04eff986d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:37:35.504778 23144 consensus_queue.cc:1035] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:37:35.505169 23139 consensus_queue.cc:1035] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 08:37:35.513756 22974 tablet.cc:2369] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:37:35.519351 23147 mvcc.cc:205] Tried to move back new op lower bound from 7316186134533500928 to 7316186134424330240. Current Snapshot: MvccSnapshot[applied={T|T < 7316186134533500928}]
I20260808 08:37:35.521237 23148 mvcc.cc:205] Tried to move back new op lower bound from 7316186134533500928 to 7316186134424330240. Current Snapshot: MvccSnapshot[applied={T|T < 7316186134533500928}]
I20260808 08:37:35.523386 23149 mvcc.cc:205] Tried to move back new op lower bound from 7316186134533500928 to 7316186134424330240. Current Snapshot: MvccSnapshot[applied={T|T < 7316186134533500928}]
I20260808 08:37:35.540808 22628 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47416:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:37:35.541118 22628 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47416:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:37:35.545622 22628 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Sending DeleteTablet for 3 replicas of tablet f295f3a1a6b14a90a414e24955046d1d
I20260808 08:37:35.546607 22762 tablet_service.cc:1514] Processing DeleteTablet for tablet f295f3a1a6b14a90a414e24955046d1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:37:35 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:59304
I20260808 08:37:35.546711 22906 tablet_service.cc:1514] Processing DeleteTablet for tablet f295f3a1a6b14a90a414e24955046d1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:37:35 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:34176
I20260808 08:37:35.548032 22905 tablet_service.cc:1514] Processing DeleteTablet for tablet f295f3a1a6b14a90a414e24955046d1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:37:35 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:34176
I20260808 08:37:35.548702 23045 tablet_service.cc:1514] Processing DeleteTablet for tablet f295f3a1a6b14a90a414e24955046d1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:37:35 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:56446
I20260808 08:37:35.549134 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 22694
I20260808 08:37:35.559688 23160 tablet_replica.cc:330] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d: stopping tablet replica
I20260808 08:37:35.560209 23160 raft_consensus.cc:2229] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:37:35.560954 23160 raft_consensus.cc:2258] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:37:35.563328 23160 ts_tablet_manager.cc:1905] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:37:35.564831 23159 tablet_replica.cc:330] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899: stopping tablet replica
I20260808 08:37:35.565045 23158 tablet_replica.cc:330] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e: stopping tablet replica
I20260808 08:37:35.565414 23159 raft_consensus.cc:2229] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:37:35.565428 23158 raft_consensus.cc:2229] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:37:35.565960 23158 raft_consensus.cc:2258] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:37:35.565960 23159 raft_consensus.cc:2258] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:37:35.568445 23159 ts_tablet_manager.cc:1905] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:37:35.569219 23158 ts_tablet_manager.cc:1905] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 08:37:35 dist-test-slave-chsk krb5kdc[22580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:37:35.575511 23159 ts_tablet_manager.cc:1918] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:37:35.575822 23159 log.cc:1196] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/f295f3a1a6b14a90a414e24955046d1d
I20260808 08:37:35.576028 23158 ts_tablet_manager.cc:1918] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:37:35.576188 23158 log.cc:1196] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/f295f3a1a6b14a90a414e24955046d1d
I20260808 08:37:35.576573 23160 ts_tablet_manager.cc:1918] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:37:35.576628 23159 ts_tablet_manager.cc:1939] T f295f3a1a6b14a90a414e24955046d1d P e416d9c2c9a44e79b0b044c3d4c98899: Deleting consensus metadata
I20260808 08:37:35.576738 23158 ts_tablet_manager.cc:1939] T f295f3a1a6b14a90a414e24955046d1d P b81c4c1dae4b4fb3ace6ae2231a6847e: Deleting consensus metadata
I20260808 08:37:35.576754 23160 log.cc:1196] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/f295f3a1a6b14a90a414e24955046d1d
I20260808 08:37:35.577358 23160 ts_tablet_manager.cc:1939] T f295f3a1a6b14a90a414e24955046d1d P 0ea795e458944e1bb680d3d04eff986d: Deleting consensus metadata
I20260808 08:37:35.578688 22612 catalog_manager.cc:4841] TS e416d9c2c9a44e79b0b044c3d4c98899 (127.5.164.194:38599): tablet f295f3a1a6b14a90a414e24955046d1d (table test-table [id=5f41da1d7b1641b5b7f1a0b39982ae18]) successfully deleted
I20260808 08:37:35.579192 22615 catalog_manager.cc:4841] TS b81c4c1dae4b4fb3ace6ae2231a6847e (127.5.164.193:42945): tablet f295f3a1a6b14a90a414e24955046d1d (table test-table [id=5f41da1d7b1641b5b7f1a0b39982ae18]) successfully deleted
W20260808 08:37:35.579285 22612 catalog_manager.cc:4808] TS e416d9c2c9a44e79b0b044c3d4c98899 (127.5.164.194:38599): delete failed for tablet f295f3a1a6b14a90a414e24955046d1d because the tablet was not found. No further retry: Not found: Tablet not found: f295f3a1a6b14a90a414e24955046d1d
I20260808 08:37:35.580480 22614 catalog_manager.cc:4841] TS 0ea795e458944e1bb680d3d04eff986d (127.5.164.195:35677): tablet f295f3a1a6b14a90a414e24955046d1d (table test-table [id=5f41da1d7b1641b5b7f1a0b39982ae18]) successfully deleted
I20260808 08:37:35.584101 23128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.550409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59320 (local address 127.5.164.193:42945)
0808 08:37:35.550606 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:35.550612 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:35.564029 (+ 13417us) server_negotiation.cc:407] Connection header received
0808 08:37:35.564284 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:35.564291 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:35.564391 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:35.564501 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:35.566557 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.567785 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.570132 (+ 2347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.570807 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.570916 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.576814 (+ 5898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:35.576829 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:35.576849 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:35.576906 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:35.581162 (+ 4256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:35.581870 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:35.581879 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:35.581885 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:35.582066 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:35.582433 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:35.582438 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:35.582442 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:35.582897 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:35.583255 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:35.583479 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 08:37:35.583715 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:37:35.584718 22827 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:35.721937 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 22694
I20260808 08:37:35.746820 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 22838
Aug 08 08:37:35 dist-test-slave-chsk krb5kdc[22580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:37:35.764065 23130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.747671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34190 (local address 127.5.164.194:38599)
0808 08:37:35.747901 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:35.747908 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:35.748003 (+ 95us) server_negotiation.cc:407] Connection header received
0808 08:37:35.748229 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:35.748235 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:35.748359 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:35.748474 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:35.749997 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.750729 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.752246 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.752678 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.752809 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.757313 (+ 4504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:35.757330 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:35.757347 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:35.757382 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:35.760861 (+ 3479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:35.761628 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:35.761635 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:35.761638 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:35.761784 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:35.762239 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:35.762253 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:35.762256 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:35.762686 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:35.763008 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:35.763370 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 08:37:35.763664 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 08:37:35.764823 22968 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:35.880430 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 22838
I20260808 08:37:35.901060 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 22980
Aug 08 08:37:35 dist-test-slave-chsk krb5kdc[22580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178252, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:37:35.920586 23132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:35.901971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56454 (local address 127.5.164.195:35677)
0808 08:37:35.902216 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:35.902221 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:35.902239 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:37:35.902419 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:35.902423 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:35.902485 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:35.902566 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:35.904592 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.905436 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.907678 (+ 2242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:35.908149 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:35.908248 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:35.914105 (+ 5857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:35.914120 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:35.914137 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:35.914187 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:35.917488 (+ 3301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:35.918232 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:35.918239 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:35.918241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:35.918412 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:35.918824 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:35.918828 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:35.918830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:35.919313 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:35.919662 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:35.919955 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 08:37:35.920187 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260808 08:37:35.921288 23107 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:36.046835 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 22980
I20260808 08:37:36.071660 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 22594
I20260808 08:37:36.072857 22659 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:36.191521 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 22594
I20260808 08:37:56.217878 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:40677
--webserver_interface=127.5.164.254
--webserver_port=33499
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:34925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:40677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:37:56.565938 23166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:56.566239 23166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:56.566394 23166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:56.573777 23166 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 08:37:56.573882 23166 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 08:37:56.573948 23166 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 08:37:56.574046 23166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:37:56.574155 23166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:56.574247 23166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:56.574334 23166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:37:56.574429 23166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:37:56.584575 23166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:40677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:40677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=33499
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:56.585937 23166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:56.587304 23166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:56.615098 23178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:56.615197 23174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:56.615123 23175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:56.616235 23166 server_base.cc:1034] running on GCE node
I20260808 08:37:56.617177 23166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:56.618829 23166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:56.620056 23166 hybrid_clock.cc:648] HybridClock initialized: now 1786178276619965 us; error 67 us; skew 500 ppm
I20260808 08:37:56.620487 23166 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:56 dist-test-slave-chsk krb5kdc[22580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178276, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:56.624231 23166 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:37:56.625989 23166 webserver.cc:460] Webserver started at http://127.5.164.254:33499/ using document root <none> and password file <none>
I20260808 08:37:56.626793 23166 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:56.626946 23166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:56.633366 23166 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.001s
I20260808 08:37:56.636593 23187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:56.637979 23166 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:37:56.638185 23166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "d7848aeef22e4e359244074d6866d4cb"
format_stamp: "Formatted at 2026-08-08 08:37:33 on dist-test-slave-chsk"
server_key: "7899fd9ed1db9b84a3f8490ad8080a92"
server_key_iv: "8d1d5508a3f2c0cc714475ddafb6f6d8"
server_key_version: "encryptionkey@0"
I20260808 08:37:56.639341 23166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:56.675235 23166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:56.679513 23166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:56.679836 23166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:56.699986 23166 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:40677
I20260808 08:37:56.700022 23240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:40677 every 8 connection(s)
I20260808 08:37:56.701609 23166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:37:56.702646 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 23166
I20260808 08:37:56.703737 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:42945
--local_ip_for_outbound_sockets=127.5.164.193
--tserver_master_addrs=127.5.164.254:40677
--webserver_port=43223
--webserver_interface=127.5.164.193
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:34925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:37:56.709367 23241 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:37:56.714195 23241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Bootstrap starting.
I20260808 08:37:56.736363 23241 log.cc:824] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:56.749351 23241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:37:56.749954 23241 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Bootstrap complete.
I20260808 08:37:56.759537 23241 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } }
I20260808 08:37:56.760402 23241 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7848aeef22e4e359244074d6866d4cb, State: Initialized, Role: FOLLOWER
I20260808 08:37:56.761147 23241 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } }
I20260808 08:37:56.761402 23241 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:37:56.761529 23241 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:37:56.761758 23241 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 1 FOLLOWER]: Advancing to term 2
I20260808 08:37:56.765878 23241 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } }
I20260808 08:37:56.766430 23241 leader_election.cc:302] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7848aeef22e4e359244074d6866d4cb; no voters:
I20260808 08:37:56.767122 23241 leader_election.cc:288] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 08:37:56.767308 23245 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 2 FOLLOWER]: Leader election won for term 2
I20260808 08:37:56.768726 23245 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 2 LEADER]: Becoming Leader. State: Replica: d7848aeef22e4e359244074d6866d4cb, State: Running, Role: LEADER
I20260808 08:37:56.769380 23245 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } }
I20260808 08:37:56.769775 23241 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:37:56.772382 23246 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d7848aeef22e4e359244074d6866d4cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } } }
I20260808 08:37:56.772805 23246 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [sys.catalog]: This master's current role is: LEADER
I20260808 08:37:56.777612 23247 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7848aeef22e4e359244074d6866d4cb. Latest consensus state: current_term: 2 leader_uuid: "d7848aeef22e4e359244074d6866d4cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } } }
I20260808 08:37:56.777989 23247 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [sys.catalog]: This master's current role is: LEADER
I20260808 08:37:56.778636 23253 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:37:56.786681 23253 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:37:56.788265 23253 catalog_manager.cc:1259] Loaded cluster ID: 4f3b128aeded4c1dad8e1df89461a493
I20260808 08:37:56.788421 23253 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:37:56.792678 23253 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:37:56.794467 23253 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Loaded TSK: 0
I20260808 08:37:56.838057 23253 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Generated new TSK 1
I20260808 08:37:56.838557 23253 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 08:37:57.085304 23243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:57.085582 23243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:57.085737 23243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:57.093021 23243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:57.093143 23243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:57.093312 23243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:37:57.103580 23243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:42945
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=43223
--tserver_master_addrs=127.5.164.254:40677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:57.104915 23243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:57.106297 23243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:57.120800 23271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:57.121069 23272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:57.121459 23274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:57.122274 23243 server_base.cc:1034] running on GCE node
I20260808 08:37:57.122927 23243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:57.123935 23243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:57.125168 23243 hybrid_clock.cc:648] HybridClock initialized: now 1786178277125111 us; error 50 us; skew 500 ppm
I20260808 08:37:57.125510 23243 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:57 dist-test-slave-chsk krb5kdc[22580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178277, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:57.128723 23243 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:37:57.130227 23243 webserver.cc:460] Webserver started at http://127.5.164.193:43223/ using document root <none> and password file <none>
I20260808 08:37:57.130919 23243 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:57.131055 23243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:57.136531 23243 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 08:37:57.139333 23281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:57.140676 23243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:37:57.140872 23243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e"
format_stamp: "Formatted at 2026-08-08 08:37:34 on dist-test-slave-chsk"
server_key: "61b456076e8c5485a14254c530903d25"
server_key_iv: "44b917422924b0c5ebed64d9d08d3d0c"
server_key_version: "encryptionkey@0"
I20260808 08:37:57.141939 23243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:57.160567 23243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:57.164848 23243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:57.165171 23243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:57.166205 23243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:37:57.167649 23243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:37:57.167780 23243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:57.167909 23243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:37:57.167999 23243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:57.202193 23243 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:42945
I20260808 08:37:57.202277 23396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:42945 every 8 connection(s)
I20260808 08:37:57.203675 23243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:37:57.206415 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 23243
I20260808 08:37:57.207329 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:38599
--local_ip_for_outbound_sockets=127.5.164.194
--tserver_master_addrs=127.5.164.254:40677
--webserver_port=45989
--webserver_interface=127.5.164.194
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:34925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:37:57 dist-test-slave-chsk krb5kdc[22580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178277, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:57.228147 23400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:57.206704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:49969)
0808 08:37:57.207757 (+ 1053us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:57.207809 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:57.209772 (+ 1963us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:57.211101 (+ 1329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:57.211114 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:57.211742 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:57.212243 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:57.212259 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:57.213856 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:57.213860 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:57.215020 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:57.215033 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:57.216089 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:57.216096 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:57.216375 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:57.217072 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:57.217093 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:57.219493 (+ 2400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:57.224216 (+ 4723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:57.224223 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:57.224232 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:57.224643 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:57.225176 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:57.225179 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:57.225182 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:57.225357 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:57.226268 (+ 911us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:57.226272 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:57.226537 (+ 265us) client_negotiation.cc:769] Sending connection context
0808 08:37:57.226755 (+ 218us) client_negotiation.cc:240] Negotiation successful
0808 08:37:57.227108 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":382,"threads_started":1}
I20260808 08:37:57.228767 23401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:57.206980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:49969 (local address 127.5.164.254:40677)
0808 08:37:57.209621 (+ 2641us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:57.209647 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:57.209698 (+ 51us) server_negotiation.cc:407] Connection header received
0808 08:37:57.210290 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:57.210302 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:57.210603 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:57.210952 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:57.212449 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:57.213677 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:57.215195 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:57.215848 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:57.216055 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:57.219817 (+ 3762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:57.219830 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:57.219850 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:57.219899 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:57.224069 (+ 4170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:57.224798 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:57.224809 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:57.224819 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:57.225052 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:57.225483 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:57.225491 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:57.225498 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:57.226131 (+ 633us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:57.226349 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:57.227051 (+ 702us) server_negotiation.cc:299] Negotiation successful
0808 08:37:57.227545 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2417,"thread_start_us":2269,"threads_started":1}
I20260808 08:37:57.231554 23397 heartbeater.cc:347] Connected to a master server at 127.5.164.254:40677
I20260808 08:37:57.231853 23397 heartbeater.cc:464] Registering TS with master...
I20260808 08:37:57.232569 23397 heartbeater.cc:511] Master 127.5.164.254:40677 requested a full tablet report, sending...
I20260808 08:37:57.234982 23204 ts_manager.cc:194] Registered new tserver with Master: b81c4c1dae4b4fb3ace6ae2231a6847e (127.5.164.193:42945)
I20260808 08:37:57.237424 23204 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:49969
W20260808 08:37:57.554025 23402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:57.554333 23402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:57.554432 23402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:57.561957 23402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:57.562105 23402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:57.562224 23402 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:37:57.572465 23402 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:38599
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=45989
--tserver_master_addrs=127.5.164.254:40677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:57.573813 23402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:57.575672 23402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:57.589031 23408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:57.589039 23407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:57.589015 23410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:57.589718 23402 server_base.cc:1034] running on GCE node
I20260808 08:37:57.590466 23402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:57.591518 23402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:57.592730 23402 hybrid_clock.cc:648] HybridClock initialized: now 1786178277592682 us; error 44 us; skew 500 ppm
I20260808 08:37:57.593022 23402 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:57 dist-test-slave-chsk krb5kdc[22580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178277, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:57.596484 23402 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:37:57.598121 23402 webserver.cc:460] Webserver started at http://127.5.164.194:45989/ using document root <none> and password file <none>
I20260808 08:37:57.598850 23402 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:57.599022 23402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:57.604705 23402 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20260808 08:37:57.607669 23417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:57.609109 23402 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:37:57.609299 23402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "e416d9c2c9a44e79b0b044c3d4c98899"
format_stamp: "Formatted at 2026-08-08 08:37:34 on dist-test-slave-chsk"
server_key: "b1109108938d992fedee5a37e80eb81c"
server_key_iv: "d1d786d8b6ccd208c658a50f4ba5499c"
server_key_version: "encryptionkey@0"
I20260808 08:37:57.610354 23402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:57.625625 23402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:57.629930 23402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:57.630236 23402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:57.631327 23402 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:37:57.632737 23402 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:37:57.632866 23402 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:57.633006 23402 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:37:57.633104 23402 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:57.668113 23402 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:38599
I20260808 08:37:57.668205 23537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:38599 every 8 connection(s)
I20260808 08:37:57.669646 23402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:37:57.673099 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 23402
I20260808 08:37:57.673964 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:35677
--local_ip_for_outbound_sockets=127.5.164.195
--tserver_master_addrs=127.5.164.254:40677
--webserver_port=40021
--webserver_interface=127.5.164.195
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:34925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 08:37:57 dist-test-slave-chsk krb5kdc[22580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178277, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:57.693994 23401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:57.672390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:44575 (local address 127.5.164.254:40677)
0808 08:37:57.672574 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:57.672578 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:57.673877 (+ 1299us) server_negotiation.cc:407] Connection header received
0808 08:37:57.676829 (+ 2952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:57.676834 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:57.676907 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:57.676998 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:57.679127 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:57.679905 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:57.682509 (+ 2604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:57.682954 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:57.683095 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:57.687699 (+ 4604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:57.687707 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:57.687715 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:57.687767 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:57.690517 (+ 2750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:57.691573 (+ 1056us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:57.691577 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:57.691580 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:57.691710 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:57.692210 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:57.692214 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:57.692216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:57.692493 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:57.692604 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:57.693533 (+ 929us) server_negotiation.cc:299] Negotiation successful
0808 08:37:57.693733 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:37:57.695741 23540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:57.672819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:44575)
0808 08:37:57.673674 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:57.673737 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:57.676518 (+ 2781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:57.677276 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:57.677290 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:57.678092 (+ 802us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:57.678914 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:57.678942 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:57.680080 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:57.680088 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:57.682319 (+ 2231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:57.682344 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:57.683265 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:57.683276 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:57.683608 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:57.684513 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:57.684549 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:57.687409 (+ 2860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:57.690687 (+ 3278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:57.690699 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:57.690721 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:57.691459 (+ 738us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:57.691827 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:57.691835 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:57.691841 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:57.692098 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:57.692628 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:57.692639 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:57.693128 (+ 489us) client_negotiation.cc:769] Sending connection context
0808 08:37:57.693452 (+ 324us) client_negotiation.cc:240] Negotiation successful
0808 08:37:57.694063 (+ 611us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":338,"threads_started":1}
I20260808 08:37:57.697446 23538 heartbeater.cc:347] Connected to a master server at 127.5.164.254:40677
I20260808 08:37:57.697804 23538 heartbeater.cc:464] Registering TS with master...
I20260808 08:37:57.698580 23538 heartbeater.cc:511] Master 127.5.164.254:40677 requested a full tablet report, sending...
I20260808 08:37:57.700352 23204 ts_manager.cc:194] Registered new tserver with Master: e416d9c2c9a44e79b0b044c3d4c98899 (127.5.164.194:38599)
I20260808 08:37:57.701797 23204 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:44575
W20260808 08:37:58.018006 23541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:37:58.018342 23541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:37:58.018440 23541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:37:58.025523 23541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:37:58.025624 23541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:37:58.025733 23541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:37:58.035292 23541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:35677
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=40021
--tserver_master_addrs=127.5.164.254:40677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:37:58.036492 23541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:37:58.037758 23541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:37:58.051393 23546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:58.051460 23549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:37:58.051424 23547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:37:58.052348 23541 server_base.cc:1034] running on GCE node
I20260808 08:37:58.053010 23541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:37:58.053954 23541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:37:58.055235 23541 hybrid_clock.cc:648] HybridClock initialized: now 1786178278055178 us; error 59 us; skew 500 ppm
I20260808 08:37:58.055569 23541 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:37:58 dist-test-slave-chsk krb5kdc[22580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178278, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:37:58.058902 23541 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:37:58.060567 23541 webserver.cc:460] Webserver started at http://127.5.164.195:40021/ using document root <none> and password file <none>
I20260808 08:37:58.061270 23541 fs_manager.cc:359] Metadata directory not provided
I20260808 08:37:58.061441 23541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:37:58.067025 23541 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 08:37:58.069802 23557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:58.071297 23541 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:37:58.071484 23541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "0ea795e458944e1bb680d3d04eff986d"
format_stamp: "Formatted at 2026-08-08 08:37:35 on dist-test-slave-chsk"
server_key: "1e3a92ce157953d7c2d2de93463a16e3"
server_key_iv: "0d0b2e1db1ed42da90659fd1589fe80e"
server_key_version: "encryptionkey@0"
I20260808 08:37:58.072487 23541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:37:58.091930 23541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:37:58.096340 23541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:37:58.096625 23541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:37:58.097640 23541 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:37:58.099009 23541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:37:58.099140 23541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:58.099289 23541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:37:58.099381 23541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:37:58.134443 23541 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:35677
I20260808 08:37:58.134516 23677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:35677 every 8 connection(s)
I20260808 08:37:58.136031 23541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:37:58.140872 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 23541
Aug 08 08:37:58 dist-test-slave-chsk krb5kdc[22580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178278, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:37:58.158107 23681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.141859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37546 (local address 127.5.164.254:40677)
0808 08:37:58.142418 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:58.142426 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:58.142763 (+ 337us) server_negotiation.cc:407] Connection header received
0808 08:37:58.142994 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:58.143001 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:58.143084 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:58.143237 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:58.145070 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.145996 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.147708 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.148153 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.148284 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.151413 (+ 3129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:58.151418 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:58.151421 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:58.151452 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:58.155186 (+ 3734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:58.155899 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:58.155905 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:58.155907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:58.156082 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:58.156494 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:58.156499 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:58.156502 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:58.156842 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:58.157090 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:58.157456 (+ 366us) server_negotiation.cc:299] Negotiation successful
0808 08:37:58.157686 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":428,"thread_start_us":300,"threads_started":1}
I20260808 08:37:58.159786 23680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.139195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:53679)
0808 08:37:58.139892 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:58.139937 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:58.141952 (+ 2015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:58.143035 (+ 1083us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:58.143047 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:58.143694 (+ 647us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:37:58.144299 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:58.144317 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.145422 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.145428 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:58.146777 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:58.146792 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.147788 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.147796 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:58.148032 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.148729 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:37:58.148789 (+ 60us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:37:58.151316 (+ 2527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:37:58.155230 (+ 3914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:58.155242 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:58.155261 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:58.155733 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:58.156188 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:37:58.156193 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:37:58.156196 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:37:58.156401 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:37:58.157019 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:37:58.157027 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:37:58.157452 (+ 425us) client_negotiation.cc:769] Sending connection context
0808 08:37:58.157780 (+ 328us) client_negotiation.cc:240] Negotiation successful
0808 08:37:58.158331 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":269,"threads_started":1}
I20260808 08:37:58.159934 23401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.138668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:53679 (local address 127.5.164.254:40677)
0808 08:37:58.138914 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:58.138919 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:58.140055 (+ 1136us) server_negotiation.cc:407] Connection header received
0808 08:37:58.142379 (+ 2324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:58.142389 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:58.142476 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:58.142550 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:58.144483 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.145243 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.146929 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.147540 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.147673 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.151537 (+ 3864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:58.151545 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:58.151554 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:58.151595 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:58.155052 (+ 3457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:58.155871 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:58.155879 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:58.155885 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:58.156069 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:58.156554 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:58.156558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:58.156560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:58.156861 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:58.157030 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:58.159345 (+ 2315us) server_negotiation.cc:299] Negotiation successful
0808 08:37:58.159555 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":65}
I20260808 08:37:58.161897 23678 heartbeater.cc:347] Connected to a master server at 127.5.164.254:40677
I20260808 08:37:58.162170 23678 heartbeater.cc:464] Registering TS with master...
I20260808 08:37:58.162839 23678 heartbeater.cc:511] Master 127.5.164.254:40677 requested a full tablet report, sending...
I20260808 08:37:58.164202 23204 ts_manager.cc:194] Registered new tserver with Master: 0ea795e458944e1bb680d3d04eff986d (127.5.164.195:35677)
I20260808 08:37:58.165001 23204 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:53679
I20260808 08:37:58.173163 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:37:58.179891 23401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.174145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37552 (local address 127.5.164.254:40677)
0808 08:37:58.174384 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:58.174391 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:58.174730 (+ 339us) server_negotiation.cc:407] Connection header received
0808 08:37:58.174905 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:58.174908 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:58.175030 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:58.175254 (+ 224us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:37:58.175795 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.176654 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.178088 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.178500 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.178592 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.179042 (+ 450us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:37:58.179384 (+ 342us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 08:37:58.179670 (+ 286us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37552: token expired
Metrics: {"server-negotiator.queue_time_us":78}
W20260808 08:37:58.180027 23401 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37552: token expired
W20260808 08:37:58.180572 23119 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.5.164.254:40677)
I20260808 08:37:58.193444 23401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.181078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37562 (local address 127.5.164.254:40677)
0808 08:37:58.181237 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:58.181241 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:58.181256 (+ 15us) server_negotiation.cc:407] Connection header received
0808 08:37:58.181363 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:58.181367 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:58.181417 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:58.181489 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:58.182880 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.183657 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.185190 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.185557 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.185646 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.188403 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:58.188407 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:58.188410 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:58.188440 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:58.190989 (+ 2549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:58.191773 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:58.191778 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:58.191780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:58.191890 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:58.192260 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:58.192264 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:58.192266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:58.192552 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:58.192737 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:58.193001 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 08:37:58.193164 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 08:37:58.197036 23204 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37562:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:37:58.205582 23204 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:37:58.234266 23689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.218365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:38599 (local address 127.0.0.1:47842)
0808 08:37:58.219310 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:58.219360 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:58.219536 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:58.226642 (+ 7106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:58.226647 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:58.226681 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:58.227218 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:58.227234 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.228943 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.228950 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:58.231077 (+ 2127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:58.231094 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.233222 (+ 2128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.233229 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:58.233442 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.233501 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 08:37:58.233642 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 08:37:58.233850 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":1166,"threads_started":1}
I20260808 08:37:58.234673 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.218990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47842 (local address 127.5.164.194:38599)
0808 08:37:58.226031 (+ 7041us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:58.226042 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:58.226070 (+ 28us) server_negotiation.cc:407] Connection header received
0808 08:37:58.226172 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:58.226182 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:58.226414 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:58.226643 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:58.227485 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.228804 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.231281 (+ 2477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.232957 (+ 1676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.233135 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.233354 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:58.233740 (+ 386us) server_negotiation.cc:299] Negotiation successful
0808 08:37:58.233937 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6829,"thread_start_us":6698,"threads_started":1}
I20260808 08:37:58.235001 23693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.218369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:35677 (local address 127.0.0.1:43684)
0808 08:37:58.225353 (+ 6984us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:58.225373 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:58.225483 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:58.227054 (+ 1571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:58.227062 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:58.227094 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:58.227608 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:58.227625 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.229850 (+ 2225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.229856 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:58.232295 (+ 2439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:58.232312 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.234066 (+ 1754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.234072 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:58.234263 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.234306 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 08:37:58.234391 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 08:37:58.234527 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6806,"mutex_wait_us":939,"thread_start_us":5753,"threads_started":1}
I20260808 08:37:58.235543 23691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.218827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42945 (local address 127.0.0.1:59240)
0808 08:37:58.224977 (+ 6150us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:58.225002 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:58.225180 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:58.226354 (+ 1174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:58.226362 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:58.226394 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:58.226952 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:58.226993 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.229923 (+ 2930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.229929 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:58.232298 (+ 2369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:58.232316 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.234607 (+ 2291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.234614 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:58.234821 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.234868 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 08:37:58.234978 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 08:37:58.235121 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5973,"mutex_wait_us":61,"thread_start_us":5791,"threads_started":1}
I20260808 08:37:58.235778 23690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.218437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43684 (local address 127.5.164.195:35677)
0808 08:37:58.226479 (+ 8042us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:58.226485 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:58.226509 (+ 24us) server_negotiation.cc:407] Connection header received
0808 08:37:58.226614 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:58.226620 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:58.226833 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:58.227036 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:58.227841 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.229687 (+ 1846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.232438 (+ 2751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.233562 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.233680 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.233900 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:58.235330 (+ 1430us) server_negotiation.cc:299] Negotiation successful
0808 08:37:58.235456 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7880,"thread_start_us":7717,"threads_started":1}
I20260808 08:37:58.236418 23694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.219493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59240 (local address 127.5.164.193:42945)
0808 08:37:58.220237 (+ 744us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:58.220249 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:58.225341 (+ 5092us) server_negotiation.cc:407] Connection header received
0808 08:37:58.225484 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:58.225493 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:58.225810 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:58.226034 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:58.227775 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.229709 (+ 1934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.232523 (+ 2814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.234017 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.234177 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.234410 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:58.235827 (+ 1417us) server_negotiation.cc:299] Negotiation successful
0808 08:37:58.236033 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":395,"threads_started":1}
I20260808 08:37:58.238842 23468 tablet_service.cc:1467] Processing CreateTablet for tablet 022d7ab178b64263be35e5160497fa60 (DEFAULT_TABLE table=test-table [id=668d0c6e10854b6b9713e0eb9fac659d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:37:58.239568 23609 tablet_service.cc:1467] Processing CreateTablet for tablet 022d7ab178b64263be35e5160497fa60 (DEFAULT_TABLE table=test-table [id=668d0c6e10854b6b9713e0eb9fac659d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:37:58.239785 23329 tablet_service.cc:1467] Processing CreateTablet for tablet 022d7ab178b64263be35e5160497fa60 (DEFAULT_TABLE table=test-table [id=668d0c6e10854b6b9713e0eb9fac659d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:37:58.240386 23468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 022d7ab178b64263be35e5160497fa60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:58.240985 23609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 022d7ab178b64263be35e5160497fa60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:58.241010 23397 heartbeater.cc:503] Master 127.5.164.254:40677 was elected leader, sending a full tablet report...
I20260808 08:37:58.241084 23329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 022d7ab178b64263be35e5160497fa60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:37:58.255658 23695 tablet_bootstrap.cc:492] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899: Bootstrap starting.
I20260808 08:37:58.257812 23696 tablet_bootstrap.cc:492] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e: Bootstrap starting.
I20260808 08:37:58.259905 23697 tablet_bootstrap.cc:492] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d: Bootstrap starting.
I20260808 08:37:58.261004 23695 tablet_bootstrap.cc:654] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:58.262519 23695 log.cc:824] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:58.262719 23696 tablet_bootstrap.cc:654] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:58.262815 23697 tablet_bootstrap.cc:654] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d: Neither blocks nor log segments found. Creating new log.
I20260808 08:37:58.263939 23696 log.cc:824] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:58.264062 23697 log.cc:824] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:37:58.266433 23697 tablet_bootstrap.cc:492] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d: No bootstrap required, opened a new log
I20260808 08:37:58.266450 23695 tablet_bootstrap.cc:492] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899: No bootstrap required, opened a new log
I20260808 08:37:58.266731 23697 ts_tablet_manager.cc:1397] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 08:37:58.266791 23695 ts_tablet_manager.cc:1397] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260808 08:37:58.269495 23696 tablet_bootstrap.cc:492] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e: No bootstrap required, opened a new log
I20260808 08:37:58.269774 23696 ts_tablet_manager.cc:1397] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260808 08:37:58.274453 23697 raft_consensus.cc:348] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } }
I20260808 08:37:58.274809 23697 raft_consensus.cc:374] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:58.274931 23697 raft_consensus.cc:729] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ea795e458944e1bb680d3d04eff986d, State: Initialized, Role: FOLLOWER
I20260808 08:37:58.275565 23697 consensus_queue.cc:260] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } }
I20260808 08:37:58.278477 23695 raft_consensus.cc:348] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } }
I20260808 08:37:58.278955 23695 raft_consensus.cc:374] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:58.279057 23695 raft_consensus.cc:729] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e416d9c2c9a44e79b0b044c3d4c98899, State: Initialized, Role: FOLLOWER
I20260808 08:37:58.279737 23695 consensus_queue.cc:260] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } }
I20260808 08:37:58.281080 23538 heartbeater.cc:503] Master 127.5.164.254:40677 was elected leader, sending a full tablet report...
I20260808 08:37:58.282083 23696 raft_consensus.cc:348] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } }
I20260808 08:37:58.282526 23696 raft_consensus.cc:374] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:37:58.282639 23696 raft_consensus.cc:729] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81c4c1dae4b4fb3ace6ae2231a6847e, State: Initialized, Role: FOLLOWER
I20260808 08:37:58.283349 23695 ts_tablet_manager.cc:1428] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899: Time spent starting tablet: real 0.016s user 0.012s sys 0.003s
I20260808 08:37:58.283429 23696 consensus_queue.cc:260] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } }
I20260808 08:37:58.284348 23678 heartbeater.cc:503] Master 127.5.164.254:40677 was elected leader, sending a full tablet report...
I20260808 08:37:58.284922 23697 ts_tablet_manager.cc:1428] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d: Time spent starting tablet: real 0.018s user 0.011s sys 0.008s
I20260808 08:37:58.288861 23696 ts_tablet_manager.cc:1428] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e: Time spent starting tablet: real 0.019s user 0.014s sys 0.003s
W20260808 08:37:58.387954 23679 tablet.cc:2369] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:37:58.421815 23539 tablet.cc:2369] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:37:58.456357 23398 tablet.cc:2369] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:37:58.530934 23702 raft_consensus.cc:482] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:37:58.531296 23702 raft_consensus.cc:504] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } }
I20260808 08:37:58.533062 23702 leader_election.cc:288] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ea795e458944e1bb680d3d04eff986d (127.5.164.195:35677), b81c4c1dae4b4fb3ace6ae2231a6847e (127.5.164.193:42945)
I20260808 08:37:58.536558 23701 raft_consensus.cc:482] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:37:58.536902 23701 raft_consensus.cc:504] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } }
I20260808 08:37:58.542101 23694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.533684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:46705 (local address 127.5.164.193:42945)
0808 08:37:58.533915 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:58.533921 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:58.534562 (+ 641us) server_negotiation.cc:407] Connection header received
0808 08:37:58.534786 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:58.534791 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:58.534868 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:58.534975 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:58.535687 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.536513 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.539217 (+ 2704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.540478 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.540646 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.540726 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:58.541462 (+ 736us) server_negotiation.cc:299] Negotiation successful
0808 08:37:58.541662 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 08:37:58.543176 23704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.533405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42945 (local address 127.5.164.194:46705)
0808 08:37:58.534435 (+ 1030us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:58.534449 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:58.534603 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:58.535033 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:58.535037 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:58.535061 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:58.535507 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:58.535521 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.536654 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.536660 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:58.539001 (+ 2341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:58.539012 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.540974 (+ 1962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.540980 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:58.541210 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.541265 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 08:37:58.542438 (+ 1173us) client_negotiation.cc:240] Negotiation successful
0808 08:37:58.542650 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":880,"mutex_wait_us":88,"thread_start_us":694,"threads_started":1}
I20260808 08:37:58.544209 23351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "022d7ab178b64263be35e5160497fa60" candidate_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" is_pre_election: true
I20260808 08:37:58.544745 23351 raft_consensus.cc:2454] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e416d9c2c9a44e79b0b044c3d4c98899 in term 0.
I20260808 08:37:58.545531 23420 leader_election.cc:302] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b81c4c1dae4b4fb3ace6ae2231a6847e, e416d9c2c9a44e79b0b044c3d4c98899; no voters:
I20260808 08:37:58.546054 23702 raft_consensus.cc:2781] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:37:58.546217 23702 raft_consensus.cc:482] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:37:58.546249 23701 leader_election.cc:288] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e416d9c2c9a44e79b0b044c3d4c98899 (127.5.164.194:38599), b81c4c1dae4b4fb3ace6ae2231a6847e (127.5.164.193:42945)
I20260808 08:37:58.546382 23702 raft_consensus.cc:3037] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:58.547376 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.539390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:55743 (local address 127.5.164.194:38599)
0808 08:37:58.539586 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:58.539591 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:58.539604 (+ 13us) server_negotiation.cc:407] Connection header received
0808 08:37:58.539642 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:58.539645 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:58.539699 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:58.539794 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:58.540341 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.541788 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.544908 (+ 3120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.546209 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.546403 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.546472 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:58.546974 (+ 502us) server_negotiation.cc:299] Negotiation successful
0808 08:37:58.547097 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:37:58.547588 23680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.538937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:38599 (local address 127.5.164.195:55743)
0808 08:37:58.539319 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:58.539339 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:58.539447 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:58.539811 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:58.539815 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:58.539858 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:58.540147 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:58.540168 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.542051 (+ 1883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.542060 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:58.544710 (+ 2650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:58.544730 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.546440 (+ 1710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.546445 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:58.546750 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.546803 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 08:37:58.546925 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 08:37:58.547113 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249}
I20260808 08:37:58.548568 23489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "022d7ab178b64263be35e5160497fa60" candidate_uuid: "0ea795e458944e1bb680d3d04eff986d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" is_pre_election: true
I20260808 08:37:58.550035 23702 raft_consensus.cc:504] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } }
I20260808 08:37:58.550485 23489 raft_consensus.cc:2379] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ea795e458944e1bb680d3d04eff986d in current term 1: Already voted for candidate e416d9c2c9a44e79b0b044c3d4c98899 in this term.
I20260808 08:37:58.551313 23351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "022d7ab178b64263be35e5160497fa60" candidate_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e"
I20260808 08:37:58.551512 23351 raft_consensus.cc:3037] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:58.551923 23690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.533545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:42527 (local address 127.5.164.195:35677)
0808 08:37:58.533773 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:58.533782 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:58.534365 (+ 583us) server_negotiation.cc:407] Connection header received
0808 08:37:58.534577 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:58.534584 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:58.534669 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:58.534783 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:58.535485 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.536312 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.539220 (+ 2908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.540837 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.540966 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.541045 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:58.551480 (+ 10435us) server_negotiation.cc:299] Negotiation successful
0808 08:37:58.551668 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 08:37:58.552690 23705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.533356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:35677 (local address 127.5.164.194:42527)
0808 08:37:58.534227 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:58.534245 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:58.534413 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:58.534819 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:58.534824 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:58.534850 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:58.535306 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:58.535320 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.536456 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.536463 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:58.538997 (+ 2534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:58.539012 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.551009 (+ 11997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.551017 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:58.551246 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.551292 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 08:37:58.552122 (+ 830us) client_negotiation.cc:240] Negotiation successful
0808 08:37:58.552279 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"mutex_wait_us":40,"thread_start_us":407,"threads_started":1}
I20260808 08:37:58.553068 23702 leader_election.cc:288] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [CANDIDATE]: Term 1 election: Requested vote from peers 0ea795e458944e1bb680d3d04eff986d (127.5.164.195:35677), b81c4c1dae4b4fb3ace6ae2231a6847e (127.5.164.193:42945)
I20260808 08:37:58.553720 23629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "022d7ab178b64263be35e5160497fa60" candidate_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea795e458944e1bb680d3d04eff986d"
I20260808 08:37:58.553750 23630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "022d7ab178b64263be35e5160497fa60" candidate_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ea795e458944e1bb680d3d04eff986d" is_pre_election: true
I20260808 08:37:58.554105 23629 raft_consensus.cc:3037] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:37:58.554836 23351 raft_consensus.cc:2454] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e416d9c2c9a44e79b0b044c3d4c98899 in term 1.
I20260808 08:37:58.555307 23420 leader_election.cc:302] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b81c4c1dae4b4fb3ace6ae2231a6847e, e416d9c2c9a44e79b0b044c3d4c98899; no voters:
I20260808 08:37:58.555604 23702 raft_consensus.cc:2781] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:37:58.555796 23694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.538937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:52431 (local address 127.5.164.193:42945)
0808 08:37:58.542384 (+ 3447us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:58.542392 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:58.546041 (+ 3649us) server_negotiation.cc:407] Connection header received
0808 08:37:58.548241 (+ 2200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:58.548250 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:58.548347 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:58.548421 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:37:58.549497 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.550677 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.553280 (+ 2603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.554632 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.554842 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.554907 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:58.555341 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 08:37:58.555472 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3317,"thread_start_us":11499,"threads_started":1}
I20260808 08:37:58.556219 23702 raft_consensus.cc:686] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [term 1 LEADER]: Becoming Leader. State: Replica: e416d9c2c9a44e79b0b044c3d4c98899, State: Running, Role: LEADER
I20260808 08:37:58.556573 23707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.540210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42945 (local address 127.5.164.195:52431)
0808 08:37:58.545926 (+ 5716us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:58.545951 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:37:58.546243 (+ 292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:37:58.548657 (+ 2414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:37:58.548665 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:37:58.548701 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:37:58.549199 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:58.549214 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.550877 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.550882 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:58.553064 (+ 2182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:37:58.553081 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.554883 (+ 1802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.554890 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:37:58.555114 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.555174 (+ 60us) client_negotiation.cc:769] Sending connection context
0808 08:37:58.556032 (+ 858us) client_negotiation.cc:240] Negotiation successful
0808 08:37:58.556223 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5474,"thread_start_us":10326,"threads_started":1}
I20260808 08:37:58.556758 23702 consensus_queue.cc:237] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } } peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } }
I20260808 08:37:58.557178 23351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "022d7ab178b64263be35e5160497fa60" candidate_uuid: "0ea795e458944e1bb680d3d04eff986d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" is_pre_election: true
I20260808 08:37:58.557490 23351 raft_consensus.cc:2379] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ea795e458944e1bb680d3d04eff986d in current term 1: Already voted for candidate e416d9c2c9a44e79b0b044c3d4c98899 in this term.
I20260808 08:37:58.557653 23629 raft_consensus.cc:2454] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e416d9c2c9a44e79b0b044c3d4c98899 in term 1.
I20260808 08:37:58.558225 23560 leader_election.cc:302] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ea795e458944e1bb680d3d04eff986d; no voters: b81c4c1dae4b4fb3ace6ae2231a6847e, e416d9c2c9a44e79b0b044c3d4c98899
I20260808 08:37:58.558568 23701 raft_consensus.cc:2726] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 08:37:58.561550 23204 catalog_manager.cc:5495] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 reported cstate change: term changed from 0 to 1, leader changed from <none> to e416d9c2c9a44e79b0b044c3d4c98899 (127.5.164.194). New cstate: current_term: 1 leader_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e416d9c2c9a44e79b0b044c3d4c98899" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260808 08:37:58.600957 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.595391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47854 (local address 127.5.164.194:38599)
0808 08:37:58.595605 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:58.595610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:58.595666 (+ 56us) server_negotiation.cc:407] Connection header received
0808 08:37:58.595881 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:58.595885 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:58.595963 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:58.596086 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:37:58.596591 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.597373 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.598763 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.599190 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.599294 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.599831 (+ 537us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:37:58.600304 (+ 473us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:37:58.600418 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:58.600547 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 08:37:58.600615 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 08:37:58.608920 23351 raft_consensus.cc:1261] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e [term 1 FOLLOWER]: Refusing update from remote peer e416d9c2c9a44e79b0b044c3d4c98899: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:37:58.608920 23629 raft_consensus.cc:1261] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d [term 1 FOLLOWER]: Refusing update from remote peer e416d9c2c9a44e79b0b044c3d4c98899: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:37:58.609894 23708 consensus_queue.cc:1035] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ea795e458944e1bb680d3d04eff986d" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 35677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:37:58.610253 23702 consensus_queue.cc:1035] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:37:58.624377 23711 mvcc.cc:205] Tried to move back new op lower bound from 7316186229172047872 to 7316186228973047808. Current Snapshot: MvccSnapshot[applied={T|T < 7316186229172047872}]
I20260808 08:37:58.636806 23203 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:37:58.637111 23203 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:37:58.640601 23203 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Sending DeleteTablet for 3 replicas of tablet 022d7ab178b64263be35e5160497fa60
I20260808 08:37:58.641811 23609 tablet_service.cc:1514] Processing DeleteTablet for tablet 022d7ab178b64263be35e5160497fa60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:37:58 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:43684
I20260808 08:37:58.642005 23329 tablet_service.cc:1514] Processing DeleteTablet for tablet 022d7ab178b64263be35e5160497fa60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:37:58 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:59240
I20260808 08:37:58.641971 23468 tablet_service.cc:1514] Processing DeleteTablet for tablet 022d7ab178b64263be35e5160497fa60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:37:58 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:47842
I20260808 08:37:58.644543 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 23243
I20260808 08:37:58.651975 23721 tablet_replica.cc:330] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e: stopping tablet replica
I20260808 08:37:58.652379 23721 raft_consensus.cc:2229] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:37:58.652843 23721 raft_consensus.cc:2258] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:37:58.656806 23721 ts_tablet_manager.cc:1905] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:37:58.658417 23722 tablet_replica.cc:330] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899: stopping tablet replica
I20260808 08:37:58.661844 23722 raft_consensus.cc:2229] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:37:58.664157 23722 raft_consensus.cc:2258] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:37:58.665176 23694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.645880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59246 (local address 127.5.164.193:42945)
0808 08:37:58.646069 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:58.646075 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:58.646093 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:37:58.646153 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:58.646158 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:58.646272 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:58.646389 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:58.649024 (+ 2635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.650191 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.652606 (+ 2415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.653305 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.653452 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.657291 (+ 3839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:58.657306 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:58.657322 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:58.657366 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:58.661486 (+ 4120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:58.662665 (+ 1179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:58.662673 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:58.662677 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:58.662829 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:58.663326 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:58.663332 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:58.663335 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:58.663780 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:58.664121 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:58.664495 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 08:37:58.664769 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 08:37:58.665571 23720 tablet_replica.cc:330] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d: stopping tablet replica
I20260808 08:37:58.665995 23720 raft_consensus.cc:2229] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:37:58.666486 23392 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:58.666489 23720 raft_consensus.cc:2258] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:37:58.670276 23722 ts_tablet_manager.cc:1905] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:37:58.678187 23720 ts_tablet_manager.cc:1905] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:37:58.682585 23722 ts_tablet_manager.cc:1918] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:37:58.682972 23722 log.cc:1196] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/022d7ab178b64263be35e5160497fa60
I20260808 08:37:58.683878 23722 ts_tablet_manager.cc:1939] T 022d7ab178b64263be35e5160497fa60 P e416d9c2c9a44e79b0b044c3d4c98899: Deleting consensus metadata
I20260808 08:37:58.685787 23188 catalog_manager.cc:4841] TS e416d9c2c9a44e79b0b044c3d4c98899 (127.5.164.194:38599): tablet 022d7ab178b64263be35e5160497fa60 (table test-table [id=668d0c6e10854b6b9713e0eb9fac659d]) successfully deleted
I20260808 08:37:58.690440 23720 ts_tablet_manager.cc:1918] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:37:58.690646 23720 log.cc:1196] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/022d7ab178b64263be35e5160497fa60
I20260808 08:37:58.691119 23720 ts_tablet_manager.cc:1939] T 022d7ab178b64263be35e5160497fa60 P 0ea795e458944e1bb680d3d04eff986d: Deleting consensus metadata
I20260808 08:37:58.692850 23189 catalog_manager.cc:4841] TS 0ea795e458944e1bb680d3d04eff986d (127.5.164.195:35677): tablet 022d7ab178b64263be35e5160497fa60 (table test-table [id=668d0c6e10854b6b9713e0eb9fac659d]) successfully deleted
I20260808 08:37:58.810307 23721 ts_tablet_manager.cc:1918] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:37:58.810585 23721 log.cc:1196] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/022d7ab178b64263be35e5160497fa60
I20260808 08:37:58.811125 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 23243
I20260808 08:37:58.811271 23721 ts_tablet_manager.cc:1939] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e: Deleting consensus metadata
W20260808 08:37:58.836776 23190 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.164.193:42945 (error 108)
I20260808 08:37:58.837060 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 23402
I20260808 08:37:58.839236 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.838316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42945 (local address 127.0.0.1:59258)
0808 08:37:58.838782 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:58.838915 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":216,"threads_started":1}
W20260808 08:37:58.839550 23190 catalog_manager.cc:4584] TS b81c4c1dae4b4fb3ace6ae2231a6847e (127.5.164.193:42945): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 022d7ab178b64263be35e5160497fa60: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42945: connect: Connection refused (error 111)
I20260808 08:37:58.859692 23692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.838007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47868 (local address 127.5.164.194:38599)
0808 08:37:58.838221 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:58.838227 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:58.838252 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:37:58.838365 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:58.838371 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:58.838490 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:58.838612 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:58.840739 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.841665 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.843256 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:58.843815 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:58.843992 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:58.852613 (+ 8621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:58.852633 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:58.852649 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:58.852695 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:58.856418 (+ 3723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:58.857270 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:58.857278 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:58.857280 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:58.857456 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:58.857921 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:58.857925 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:58.857927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:58.858334 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:58.858682 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:58.859015 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 08:37:58.859323 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:37:58.860494 23533 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:58.893448 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.892875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42945 (local address 127.0.0.1:59268)
0808 08:37:58.893142 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:58.893270 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260808 08:37:58.894594 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.894170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42945 (local address 127.0.0.1:59274)
0808 08:37:58.894340 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:58.894428 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 08:37:58.955396 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.954798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42945 (local address 127.0.0.1:59286)
0808 08:37:58.955048 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:58.955209 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260808 08:37:58.956486 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:58.956079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42945 (local address 127.0.0.1:59294)
0808 08:37:58.956233 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:58.956317 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 08:37:58.978678 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 23402
I20260808 08:37:59.001608 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 23541
I20260808 08:37:59.015818 23690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:59.002387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43690 (local address 127.5.164.195:35677)
0808 08:37:59.002572 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 08:37:59.002580 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:37:59.002674 (+ 94us) server_negotiation.cc:407] Connection header received
0808 08:37:59.002904 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:37:59.002908 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:37:59.002987 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:37:59.003127 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:37:59.004575 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:59.005316 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:59.006757 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:37:59.007237 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:37:59.007373 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:37:59.010180 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:37:59.010194 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:37:59.010210 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:37:59.010254 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:37:59.012900 (+ 2646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:59.013579 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:59.013595 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:59.013597 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:59.013744 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:37:59.014141 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:37:59.014147 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:37:59.014150 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:37:59.014489 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:37:59.014786 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0808 08:37:59.015165 (+ 379us) server_negotiation.cc:299] Negotiation successful
0808 08:37:59.015378 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:37:59.016489 23673 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:59.037855 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:59.037303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42945 (local address 127.0.0.1:59302)
0808 08:37:59.037596 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:59.037697 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260808 08:37:59.039034 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:59.038574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42945 (local address 127.0.0.1:59308)
0808 08:37:59.038805 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:59.038879 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260808 08:37:59.110272 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 23541
I20260808 08:37:59.130653 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 23166
I20260808 08:37:59.131906 23236 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:37:59.249600 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 23166
I20260808 08:37:59.249670 23725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:37:59.248711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42945 (local address 127.0.0.1:59322)
0808 08:37:59.249083 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0808 08:37:59.249282 (+ 199us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199}
I20260808 08:38:19.277541 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:40677
--webserver_interface=127.5.164.254
--webserver_port=33499
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:34925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:40677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:38:19.632395 23730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:19.632695 23730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:19.632861 23730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:19.640338 23730 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 08:38:19.640492 23730 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 08:38:19.640584 23730 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 08:38:19.640681 23730 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:38:19.640781 23730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:19.640908 23730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:19.640998 23730 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:38:19.641090 23730 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:38:19.651718 23730 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:40677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:40677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=33499
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:19.653504 23730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:19.654881 23730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:19.667224 23736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:19.667200 23739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:19.667259 23737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:19.667819 23730 server_base.cc:1034] running on GCE node
I20260808 08:38:19.668725 23730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:19.670081 23730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:19.671330 23730 hybrid_clock.cc:648] HybridClock initialized: now 1786178299671270 us; error 37 us; skew 500 ppm
I20260808 08:38:19.671675 23730 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:38:19 dist-test-slave-chsk krb5kdc[22580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178299, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:38:19.683624 23730 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:38:19.685232 23730 webserver.cc:460] Webserver started at http://127.5.164.254:33499/ using document root <none> and password file <none>
I20260808 08:38:19.685986 23730 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:19.686128 23730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:19.691772 23730 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 08:38:19.694557 23746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:19.695822 23730 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:38:19.696009 23730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "d7848aeef22e4e359244074d6866d4cb"
format_stamp: "Formatted at 2026-08-08 08:37:33 on dist-test-slave-chsk"
server_key: "7899fd9ed1db9b84a3f8490ad8080a92"
server_key_iv: "8d1d5508a3f2c0cc714475ddafb6f6d8"
server_key_version: "encryptionkey@0"
I20260808 08:38:19.696981 23730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:19.712137 23730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:19.716274 23730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:19.716567 23730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:19.737259 23730 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:40677
I20260808 08:38:19.737253 23801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:40677 every 8 connection(s)
I20260808 08:38:19.739295 23730 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:38:19.742836 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 23730
I20260808 08:38:19.743993 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:42945
--local_ip_for_outbound_sockets=127.5.164.193
--tserver_master_addrs=127.5.164.254:40677
--webserver_port=43223
--webserver_interface=127.5.164.193
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:34925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:38:19.748167 23802 sys_catalog.cc:263] Verifying existing consensus state
I20260808 08:38:19.753185 23802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Bootstrap starting.
I20260808 08:38:19.774716 23802 log.cc:824] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:19.790758 23802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 08:38:19.791581 23802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Bootstrap complete.
I20260808 08:38:19.801348 23802 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } }
I20260808 08:38:19.802314 23802 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7848aeef22e4e359244074d6866d4cb, State: Initialized, Role: FOLLOWER
I20260808 08:38:19.802987 23802 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } }
I20260808 08:38:19.803251 23802 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:38:19.803407 23802 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:38:19.803607 23802 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 2 FOLLOWER]: Advancing to term 3
I20260808 08:38:19.807331 23802 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } }
I20260808 08:38:19.807790 23802 leader_election.cc:302] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7848aeef22e4e359244074d6866d4cb; no voters:
I20260808 08:38:19.808494 23802 leader_election.cc:288] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 08:38:19.808647 23808 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 3 FOLLOWER]: Leader election won for term 3
I20260808 08:38:19.810006 23808 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [term 3 LEADER]: Becoming Leader. State: Replica: d7848aeef22e4e359244074d6866d4cb, State: Running, Role: LEADER
I20260808 08:38:19.810546 23808 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } }
I20260808 08:38:19.810765 23802 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:38:19.813490 23809 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "d7848aeef22e4e359244074d6866d4cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } } }
I20260808 08:38:19.814005 23810 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7848aeef22e4e359244074d6866d4cb. Latest consensus state: current_term: 3 leader_uuid: "d7848aeef22e4e359244074d6866d4cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7848aeef22e4e359244074d6866d4cb" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 40677 } } }
I20260808 08:38:19.817075 23810 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [sys.catalog]: This master's current role is: LEADER
I20260808 08:38:19.817520 23809 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb [sys.catalog]: This master's current role is: LEADER
I20260808 08:38:19.824576 23815 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:38:19.833600 23815 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:38:19.835157 23815 catalog_manager.cc:1259] Loaded cluster ID: 4f3b128aeded4c1dad8e1df89461a493
I20260808 08:38:19.835268 23815 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:38:19.839705 23815 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:38:19.841441 23815 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Loaded TSK: 0
I20260808 08:38:19.841585 23815 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d7848aeef22e4e359244074d6866d4cb: Loaded TSK: 1
F20260808 08:38:19.842769 23815 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f28904ee9ad google::LogMessage::Fail() at ??:0
@ 0x7f28904f188a google::LogMessage::SendToLog() at ??:0
I20260808 08:38:19.849035 23826 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f28904ee4de google::LogMessage::Flush() at ??:0
@ 0x7f28904efa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f28942527d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f289424173e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f28a5f211c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f28a5f20783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f28a5fac2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f28a5fac0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f28a5ff65e9 std::function<>::operator()() at ??:0
@ 0x7f28a5f24cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f28a5f22c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f28a5faa610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f28a5faa439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f289313a345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f289313d91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f289313d799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f2893118eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f28963f26db start_thread at ??:0
@ 0x7f288f38861f clone at ??:0
W20260808 08:38:20.127580 23805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:20.127915 23805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:20.128089 23805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:20.135695 23805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:20.135854 23805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:20.136032 23805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:38:20.146440 23805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:42945
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=43223
--tserver_master_addrs=127.5.164.254:40677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:20.147909 23805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:20.149273 23805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:20.163350 23853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:20.163391 23854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:20.163537 23856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:20.164091 23805 server_base.cc:1034] running on GCE node
I20260808 08:38:20.164721 23805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:20.165702 23805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:20.166942 23805 hybrid_clock.cc:648] HybridClock initialized: now 1786178300166892 us; error 48 us; skew 500 ppm
I20260808 08:38:20.167349 23805 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:38:20 dist-test-slave-chsk krb5kdc[22580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178300, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:38:20.170588 23805 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:38:20.172169 23805 webserver.cc:460] Webserver started at http://127.5.164.193:43223/ using document root <none> and password file <none>
I20260808 08:38:20.172863 23805 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:20.173017 23805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:20.178434 23805 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 08:38:20.181269 23863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:20.182646 23805 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:38:20.182824 23805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "b81c4c1dae4b4fb3ace6ae2231a6847e"
format_stamp: "Formatted at 2026-08-08 08:37:34 on dist-test-slave-chsk"
server_key: "61b456076e8c5485a14254c530903d25"
server_key_iv: "44b917422924b0c5ebed64d9d08d3d0c"
server_key_version: "encryptionkey@0"
I20260808 08:38:20.183918 23805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:20.198994 23805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:20.202884 23805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:20.203250 23805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:20.204227 23805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:20.205976 23871 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260808 08:38:20.211283 23871 ts_tablet_manager.cc:1852] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260808 08:38:20.212333 23871 ts_tablet_manager.cc:1905] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:38:20.219841 23871 ts_tablet_manager.cc:1918] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:20.220172 23871 ts_tablet_manager.cc:1939] T 022d7ab178b64263be35e5160497fa60 P b81c4c1dae4b4fb3ace6ae2231a6847e: Deleting consensus metadata
I20260808 08:38:20.220712 23805 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260808 08:38:20.220856 23805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.015s user 0.001s sys 0.000s
I20260808 08:38:20.221002 23805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:20.221098 23805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:20.256788 23805 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:42945
I20260808 08:38:20.256878 23982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:42945 every 8 connection(s)
I20260808 08:38:20.258180 23805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:38:20.263196 23985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:20.261288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:38191)
0808 08:38:20.262054 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:20.262299 (+ 245us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":315,"threads_started":1}
W20260808 08:38:20.263809 23983 heartbeater.cc:644] Failed to heartbeat to 127.5.164.254:40677 (0 consecutive failures): Network error: Failed to ping master at 127.5.164.254:40677: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
I20260808 08:38:20.264554 23985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:20.264245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:42867)
0808 08:38:20.264385 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:20.264453 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 08:38:20.265367 23985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:20.265036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:59335)
0808 08:38:20.265174 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:20.265258 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 08:38:20.265575 23983 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 08:38:20.268234 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 23805
I20260808 08:38:20.268853 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:38599
--local_ip_for_outbound_sockets=127.5.164.194
--tserver_master_addrs=127.5.164.254:40677
--webserver_port=45989
--webserver_interface=127.5.164.194
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:34925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:38:20.608390 23986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:20.608700 23986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:20.608834 23986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:20.616334 23986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:20.616478 23986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:20.616667 23986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:38:20.626685 23986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:38599
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=45989
--tserver_master_addrs=127.5.164.254:40677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:20.628050 23986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:20.629374 23986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:20.642614 23991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:20.642673 23994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:20.642699 23992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:20.643373 23986 server_base.cc:1034] running on GCE node
I20260808 08:38:20.643944 23986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:20.644802 23986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:20.646030 23986 hybrid_clock.cc:648] HybridClock initialized: now 1786178300645993 us; error 45 us; skew 500 ppm
I20260808 08:38:20.646349 23986 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:38:20 dist-test-slave-chsk krb5kdc[22580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178300, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:38:20.649390 23986 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:38:20.650810 23986 webserver.cc:460] Webserver started at http://127.5.164.194:45989/ using document root <none> and password file <none>
I20260808 08:38:20.651546 23986 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:20.651690 23986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:20.656772 23986 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260808 08:38:20.659519 24003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:20.660782 23986 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:38:20.660964 23986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "e416d9c2c9a44e79b0b044c3d4c98899"
format_stamp: "Formatted at 2026-08-08 08:37:34 on dist-test-slave-chsk"
server_key: "b1109108938d992fedee5a37e80eb81c"
server_key_iv: "d1d786d8b6ccd208c658a50f4ba5499c"
server_key_version: "encryptionkey@0"
I20260808 08:38:20.661964 23986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:20.676730 23986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:20.680519 23986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:20.680807 23986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:20.681767 23986 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:20.683063 23986 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:20.683233 23986 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:20.683355 23986 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:20.683444 23986 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:20.717514 23986 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:38599
I20260808 08:38:20.717604 24120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:38599 every 8 connection(s)
I20260808 08:38:20.718997 23986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:38:20.724100 24123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:20.722246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:50417)
0808 08:38:20.722978 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:20.723281 (+ 303us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":284,"threads_started":1}
W20260808 08:38:20.724722 24121 heartbeater.cc:644] Failed to heartbeat to 127.5.164.254:40677 (0 consecutive failures): Network error: Failed to ping master at 127.5.164.254:40677: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
I20260808 08:38:20.725483 24123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:20.725158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:37223)
0808 08:38:20.725315 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:20.725383 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 08:38:20.726271 24123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:20.725974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:34191)
0808 08:38:20.726095 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:20.726169 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 08:38:20.726523 24121 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 08:38:20.729453 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 23986
I20260808 08:38:20.730154 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:35677
--local_ip_for_outbound_sockets=127.5.164.195
--tserver_master_addrs=127.5.164.254:40677
--webserver_port=40021
--webserver_interface=127.5.164.195
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:34925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:38:21.067466 24124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:21.067795 24124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:21.067960 24124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:21.075217 24124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:21.075374 24124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:21.075546 24124 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:38:21.085425 24124 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:35677
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=40021
--tserver_master_addrs=127.5.164.254:40677
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:21.086877 24124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:21.088388 24124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:21.102201 24129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:21.102113 24130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:21.102159 24132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:21.103125 24124 server_base.cc:1034] running on GCE node
I20260808 08:38:21.103829 24124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:21.104797 24124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:21.106015 24124 hybrid_clock.cc:648] HybridClock initialized: now 1786178301105977 us; error 27 us; skew 500 ppm
I20260808 08:38:21.106319 24124 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:38:21 dist-test-slave-chsk krb5kdc[22580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178301, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:38:21.109637 24124 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:38:21.111410 24124 webserver.cc:460] Webserver started at http://127.5.164.195:40021/ using document root <none> and password file <none>
I20260808 08:38:21.112167 24124 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:21.112325 24124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:21.118032 24124 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260808 08:38:21.120965 24139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:21.122397 24124 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:38:21.122601 24124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "0ea795e458944e1bb680d3d04eff986d"
format_stamp: "Formatted at 2026-08-08 08:37:35 on dist-test-slave-chsk"
server_key: "1e3a92ce157953d7c2d2de93463a16e3"
server_key_iv: "0d0b2e1db1ed42da90659fd1589fe80e"
server_key_version: "encryptionkey@0"
I20260808 08:38:21.123749 24124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:21.138641 24124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:21.142853 24124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:21.143204 24124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:21.144212 24124 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:21.145527 24124 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:21.145654 24124 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:21.145793 24124 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:21.145892 24124 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:21.180275 24124 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:35677
I20260808 08:38:21.180363 24258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:35677 every 8 connection(s)
I20260808 08:38:21.181816 24124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:38:21.186684 24261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:21.184850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:40779)
0808 08:38:21.185556 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:21.185787 (+ 231us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":279,"threads_started":1}
W20260808 08:38:21.187430 24259 heartbeater.cc:644] Failed to heartbeat to 127.5.164.254:40677 (0 consecutive failures): Network error: Failed to ping master at 127.5.164.254:40677: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
I20260808 08:38:21.188230 24261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:21.187864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:50455)
0808 08:38:21.188056 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:21.188121 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 08:38:21.189070 24261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:21.188757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:45815)
0808 08:38:21.188893 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:21.188971 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 08:38:21.189330 24259 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 08:38:21.191572 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 24124
I20260808 08:38:21.266918 24263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:21.266114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:58373)
0808 08:38:21.266612 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:21.266693 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":211,"threads_started":1}
I20260808 08:38:21.728300 24264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:21.727106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:33633)
0808 08:38:21.727736 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:21.727905 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":217,"threads_started":1}
I20260808 08:38:22.190623 24265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:22.189833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:48653)
0808 08:38:22.190295 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:22.190401 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":237,"threads_started":1}
I20260808 08:38:22.268587 24266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:22.267862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:46461)
0808 08:38:22.268324 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:22.268409 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":269,"threads_started":1}
I20260808 08:38:22.729772 24267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:22.729106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:43415)
0808 08:38:22.729538 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:22.729614 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":211,"threads_started":1}
I20260808 08:38:23.192440 24268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:23.191651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:60513)
0808 08:38:23.192162 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:23.192270 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":246,"threads_started":1}
I20260808 08:38:23.270308 24269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:23.269531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:53105)
0808 08:38:23.270025 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:23.270121 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":237,"threads_started":1}
I20260808 08:38:23.731953 24270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:23.730872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:60985)
0808 08:38:23.731538 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:23.731693 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":333,"threads_started":1}
I20260808 08:38:24.194057 24271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:24.193337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:42197)
0808 08:38:24.193799 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:24.193883 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":240,"threads_started":1}
I20260808 08:38:24.272094 24272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:24.271351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:47473)
0808 08:38:24.271825 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:24.271913 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":232,"threads_started":1}
I20260808 08:38:24.733691 24273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:24.732965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:50283)
0808 08:38:24.733409 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:24.733495 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":217,"threads_started":1}
I20260808 08:38:25.196038 24274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:25.195057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:59013)
0808 08:38:25.195656 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:25.195770 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":316,"threads_started":1}
I20260808 08:38:25.273792 24275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:25.273043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:53381)
0808 08:38:25.273534 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:25.273622 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":233,"threads_started":1}
I20260808 08:38:25.735440 24276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:25.734663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:49061)
0808 08:38:25.735116 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:25.735267 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":231,"threads_started":1}
I20260808 08:38:26.197748 24277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:26.196986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:45433)
0808 08:38:26.197499 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:26.197581 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":282,"threads_started":1}
I20260808 08:38:26.275519 24278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:26.274708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:47697)
0808 08:38:26.275257 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:26.275341 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":230,"threads_started":1}
I20260808 08:38:26.737396 24279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:26.736549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:53113)
0808 08:38:26.737137 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:26.737229 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":340,"threads_started":1}
I20260808 08:38:27.199455 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:27.198663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:42549)
0808 08:38:27.199123 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:27.199285 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":235,"threads_started":1}
I20260808 08:38:27.277244 24281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:27.276411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:53415)
0808 08:38:27.276943 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:27.277034 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":259,"threads_started":1}
I20260808 08:38:27.739526 24282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:27.738519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:53911)
0808 08:38:27.739071 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:27.739282 (+ 211us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":245,"threads_started":1}
I20260808 08:38:28.201205 24284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:28.200355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:58217)
0808 08:38:28.200890 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:28.200976 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":239,"threads_started":1}
I20260808 08:38:28.279043 24285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:28.278217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:51185)
0808 08:38:28.278761 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:28.278844 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":326,"threads_started":1}
I20260808 08:38:28.741645 24286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:28.740638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:48579)
0808 08:38:28.741138 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:28.741427 (+ 289us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":254,"threads_started":1}
I20260808 08:38:29.203099 24287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:29.202290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:36355)
0808 08:38:29.202830 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:29.202924 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":281,"threads_started":1}
I20260808 08:38:29.280913 24288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:29.280087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:46869)
0808 08:38:29.280648 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:29.280752 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":295,"threads_started":1}
I20260808 08:38:29.743428 24289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:29.742598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:47021)
0808 08:38:29.743086 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:29.743230 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":235,"threads_started":1}
I20260808 08:38:30.204862 24290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:30.204124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:51229)
0808 08:38:30.204609 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:30.204689 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":233,"threads_started":1}
I20260808 08:38:30.282593 24291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:30.281893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:49409)
0808 08:38:30.282334 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:30.282415 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":246,"threads_started":1}
I20260808 08:38:30.744993 24292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:30.744299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:42099)
0808 08:38:30.744754 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:30.744832 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":249,"threads_started":1}
I20260808 08:38:31.206633 24293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:31.205886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:52853)
0808 08:38:31.206370 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:31.206457 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":266,"threads_started":1}
I20260808 08:38:31.284439 24294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:31.283575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:60311)
0808 08:38:31.284163 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:31.284253 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":345,"threads_started":1}
I20260808 08:38:31.746658 24295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:31.745941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:54341)
0808 08:38:31.746385 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:31.746473 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":222,"threads_started":1}
I20260808 08:38:32.208416 24296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:32.207675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:47619)
0808 08:38:32.208132 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:32.208231 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":209,"threads_started":1}
I20260808 08:38:32.286146 24297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:32.285325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:52243)
0808 08:38:32.285807 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:32.285915 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":232,"threads_started":1}
I20260808 08:38:32.748350 24299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:32.747615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:43765)
0808 08:38:32.748089 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:32.748192 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":234,"threads_started":1}
I20260808 08:38:33.210101 24300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:33.209370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:46705)
0808 08:38:33.209823 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:33.209941 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":224,"threads_started":1}
I20260808 08:38:33.287926 24301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:33.287042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:48543)
0808 08:38:33.287577 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:33.287717 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":290,"threads_started":1}
I20260808 08:38:33.750345 24302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:33.749367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:46335)
0808 08:38:33.749959 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:33.750113 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":324,"threads_started":1}
I20260808 08:38:34.211889 24303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:34.211025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:50945)
0808 08:38:34.211590 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:34.211694 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":319,"threads_started":1}
I20260808 08:38:34.289752 24304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:34.288951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:43575)
0808 08:38:34.289452 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:34.289540 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":265,"threads_started":1}
I20260808 08:38:34.752200 24305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:34.751408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:58597)
0808 08:38:34.751898 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:34.751985 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":261,"threads_started":1}
I20260808 08:38:35.213824 24306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:35.212881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:47449)
0808 08:38:35.213446 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:35.213560 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":312,"threads_started":1}
I20260808 08:38:35.291877 24307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:35.291030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.193:57975)
0808 08:38:35.291610 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:35.291704 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":280,"threads_started":1}
I20260808 08:38:35.754262 24308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:35.753412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.194:58265)
0808 08:38:35.753966 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:35.754064 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":307,"threads_started":1}
I20260808 08:38:36.195243 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 23805
I20260808 08:38:36.214283 24309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:36.196673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48292 (local address 127.5.164.193:42945)
0808 08:38:36.197262 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:36.197278 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:36.197317 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:38:36.199020 (+ 1703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:36.199031 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:36.199536 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:36.199848 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:36.201302 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:36.202535 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:36.203973 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:36.204687 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:36.204828 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:36.207811 (+ 2983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:36.207819 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:36.207835 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:36.207871 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:36.210868 (+ 2997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:36.211719 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:36.211726 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:36.211732 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:36.211905 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:36.212271 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:36.212274 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:36.212276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:36.212811 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:36.213044 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:36.213394 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 08:38:36.213937 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":303,"threads_started":1}
I20260808 08:38:36.215844 24310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:36.214990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:40677 (local address 127.5.164.195:54499)
0808 08:38:36.215542 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:36.215669 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.254:40677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":283,"threads_started":1}
I20260808 08:38:36.215991 23978 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:36.312120 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 23805
I20260808 08:38:36.334513 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 23986
I20260808 08:38:36.352692 24313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:36.335636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53012 (local address 127.5.164.194:38599)
0808 08:38:36.336274 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:36.336288 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:36.336325 (+ 37us) server_negotiation.cc:407] Connection header received
0808 08:38:36.337899 (+ 1574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:36.337909 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:36.338326 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:36.338632 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:36.340266 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:36.341524 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:36.342932 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:36.343710 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:36.343864 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:36.346588 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:36.346596 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:36.346611 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:36.346649 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:36.349523 (+ 2874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:36.350347 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:36.350354 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:36.350360 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:36.350532 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:36.350883 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:36.350886 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:36.350887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:36.351468 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:36.351714 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:36.352069 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 08:38:36.352391 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":323,"threads_started":1}
I20260808 08:38:36.354096 24116 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:36.439079 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 23986
I20260808 08:38:36.461374 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 24124
I20260808 08:38:36.479910 24315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:36.462471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44876 (local address 127.5.164.195:35677)
0808 08:38:36.463117 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:36.463131 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:36.463234 (+ 103us) server_negotiation.cc:407] Connection header received
0808 08:38:36.464976 (+ 1742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:36.464987 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:36.465413 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:36.465708 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:36.467040 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:36.468321 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:36.469936 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:36.470603 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:36.470759 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:36.473631 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:36.473638 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:36.473653 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:36.473701 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:36.476612 (+ 2911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:36.477333 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:36.477339 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:36.477345 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:36.477508 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:36.477918 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:36.477921 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:36.477923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:36.478435 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:36.478655 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:36.479084 (+ 429us) server_negotiation.cc:299] Negotiation successful
0808 08:38:36.479595 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":311,"threads_started":1}
I20260808 08:38:36.481267 24253 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:36.566030 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 24124
2026-08-08T08:38:36Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64998 ms)
[----------] 30 tests from SecurityITest (312008 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:38:36 dist-test-slave-chsk krb5kdc[24320](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:38:36 dist-test-slave-chsk krb5kdc[24320](info): set up 2 sockets
Aug 08 08:38:36 dist-test-slave-chsk krb5kdc[24320](info): commencing operation
krb5kdc: starting...
W20260808 08:38:37.739192 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.001s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:38:37 dist-test-slave-chsk krb5kdc[24320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:38:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:38:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:38:38.086995 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:45281
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:45281
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:38:38.444808 24335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:38.445190 24335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:38.445369 24335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:38.452651 24335 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:38:38.452833 24335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:38.452948 24335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:38.453058 24335 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:38:38.453127 24335 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:38:38.463395 24335 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:45281
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:45281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:38.464941 24335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:38.466338 24335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:38.478729 24341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:38.478695 24343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:38.478770 24340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:38.479590 24335 server_base.cc:1034] running on GCE node
I20260808 08:38:38.480393 24335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:38.481829 24335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:38.483044 24335 hybrid_clock.cc:648] HybridClock initialized: now 1786178318482999 us; error 45 us; skew 500 ppm
I20260808 08:38:38.483451 24335 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:38:38 dist-test-slave-chsk krb5kdc[24320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178318, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:38:38.486810 24335 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:38:38.488579 24335 webserver.cc:460] Webserver started at http://127.5.164.254:44919/ using document root <none> and password file <none>
I20260808 08:38:38.489326 24335 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:38.489486 24335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:38.489826 24335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:38.493100 24335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "414dccd3f3a541ee88e716df919f0387"
format_stamp: "Formatted at 2026-08-08 08:38:38 on dist-test-slave-chsk"
server_key: "fd7a63c9c97ba1e5bdac80a16750a1db"
server_key_iv: "1155422e3f13eb66e0d6df03113fac8d"
server_key_version: "encryptionkey@0"
I20260808 08:38:38.493906 24335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "414dccd3f3a541ee88e716df919f0387"
format_stamp: "Formatted at 2026-08-08 08:38:38 on dist-test-slave-chsk"
server_key: "fd7a63c9c97ba1e5bdac80a16750a1db"
server_key_iv: "1155422e3f13eb66e0d6df03113fac8d"
server_key_version: "encryptionkey@0"
I20260808 08:38:38.499456 24335 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 08:38:38.503113 24350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:38.504537 24335 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:38:38.504751 24335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "414dccd3f3a541ee88e716df919f0387"
format_stamp: "Formatted at 2026-08-08 08:38:38 on dist-test-slave-chsk"
server_key: "fd7a63c9c97ba1e5bdac80a16750a1db"
server_key_iv: "1155422e3f13eb66e0d6df03113fac8d"
server_key_version: "encryptionkey@0"
I20260808 08:38:38.504967 24335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:38.533666 24335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:38.538476 24335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:38.538802 24335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:38.558840 24335 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:45281
I20260808 08:38:38.558871 24403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:45281 every 8 connection(s)
I20260808 08:38:38.560369 24335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:38:38.561218 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 24335
I20260808 08:38:38.561530 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:38:38.562265 5779 external_mini_cluster.cc:1428] Setting key d75049e3e3518bcf9786aa8b4d7a8bf1
I20260808 08:38:38.564970 24404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:38:38 dist-test-slave-chsk krb5kdc[24320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:38:38.578974 24404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387: Bootstrap starting.
I20260808 08:38:38.582465 24404 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:38.583657 24404 log.cc:824] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:38.586802 24404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387: No bootstrap required, opened a new log
I20260808 08:38:38.587124 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:38.564445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57732 (local address 127.5.164.254:45281)
0808 08:38:38.565346 (+ 901us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:38.565359 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:38.565407 (+ 48us) server_negotiation.cc:407] Connection header received
0808 08:38:38.567096 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:38.567117 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:38.567584 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:38.567924 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:38.569874 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:38.571321 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:38.573216 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:38.573894 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:38.574024 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:38.579275 (+ 5251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:38.579286 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:38.579302 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:38.579350 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:38.582612 (+ 3262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:38.583539 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:38.583546 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:38.583553 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:38.583737 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:38.584183 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:38.584189 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:38.584192 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:38.584795 (+ 603us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:38.585164 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:38.585614 (+ 450us) server_negotiation.cc:299] Negotiation successful
0808 08:38:38.586069 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":668,"thread_start_us":403,"threads_started":1}
I20260808 08:38:38.595450 24404 raft_consensus.cc:348] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "414dccd3f3a541ee88e716df919f0387" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45281 } }
I20260808 08:38:38.595881 24404 raft_consensus.cc:374] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:38.595992 24404 raft_consensus.cc:729] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414dccd3f3a541ee88e716df919f0387, State: Initialized, Role: FOLLOWER
I20260808 08:38:38.596625 24404 consensus_queue.cc:260] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "414dccd3f3a541ee88e716df919f0387" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45281 } }
I20260808 08:38:38.596884 24404 raft_consensus.cc:388] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:38:38.597034 24404 raft_consensus.cc:482] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:38:38.597234 24404 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:38.600030 24404 raft_consensus.cc:504] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "414dccd3f3a541ee88e716df919f0387" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45281 } }
I20260808 08:38:38.600592 24404 leader_election.cc:302] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 414dccd3f3a541ee88e716df919f0387; no voters:
I20260808 08:38:38.601207 24404 leader_election.cc:288] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:38:38.601369 24411 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:38:38.602141 24411 raft_consensus.cc:686] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [term 1 LEADER]: Becoming Leader. State: Replica: 414dccd3f3a541ee88e716df919f0387, State: Running, Role: LEADER
I20260808 08:38:38.602784 24411 consensus_queue.cc:237] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "414dccd3f3a541ee88e716df919f0387" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45281 } }
I20260808 08:38:38.603493 24404 sys_catalog.cc:564] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:38:38.605880 24413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 414dccd3f3a541ee88e716df919f0387. Latest consensus state: current_term: 1 leader_uuid: "414dccd3f3a541ee88e716df919f0387" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "414dccd3f3a541ee88e716df919f0387" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45281 } } }
I20260808 08:38:38.606385 24413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [sys.catalog]: This master's current role is: LEADER
I20260808 08:38:38.607249 24412 sys_catalog.cc:455] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "414dccd3f3a541ee88e716df919f0387" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "414dccd3f3a541ee88e716df919f0387" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45281 } } }
I20260808 08:38:38.608628 24412 sys_catalog.cc:458] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387 [sys.catalog]: This master's current role is: LEADER
I20260808 08:38:38.608912 24416 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:38:38.614554 24416 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:38:38.624405 24416 catalog_manager.cc:1347] Generated new cluster ID: 6c1970763cf34213a15e989fcfa9a677
I20260808 08:38:38.624545 24416 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:38:38.638700 24416 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:38:38.640388 24416 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:38:38.649819 24416 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387: Generated new TSK 0
I20260808 08:38:38.650677 24416 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:38:38.734772 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45281
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:38:39.117643 24432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:39.117928 24432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:39.118119 24432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:39.125433 24432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:39.125552 24432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:39.125761 24432 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:38:39.135661 24432 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45281
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:39.136970 24432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:39.138309 24432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:39.152294 24438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:39.152287 24437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:39.152436 24440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:39.153234 24432 server_base.cc:1034] running on GCE node
I20260808 08:38:39.153889 24432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:39.154872 24432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:39.156143 24432 hybrid_clock.cc:648] HybridClock initialized: now 1786178319156078 us; error 73 us; skew 500 ppm
I20260808 08:38:39.156482 24432 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:38:39 dist-test-slave-chsk krb5kdc[24320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178319, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:38:39.171245 24432 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:38:39.172773 24432 webserver.cc:460] Webserver started at http://127.5.164.193:44885/ using document root <none> and password file <none>
I20260808 08:38:39.173468 24432 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:39.173604 24432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:39.173938 24432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:39.176894 24432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d"
format_stamp: "Formatted at 2026-08-08 08:38:39 on dist-test-slave-chsk"
server_key: "bcd743ba1a0641d50e8f45d0b62af749"
server_key_iv: "81f121cf51e6ef354744e45241d26ab5"
server_key_version: "encryptionkey@0"
I20260808 08:38:39.177704 24432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d"
format_stamp: "Formatted at 2026-08-08 08:38:39 on dist-test-slave-chsk"
server_key: "bcd743ba1a0641d50e8f45d0b62af749"
server_key_iv: "81f121cf51e6ef354744e45241d26ab5"
server_key_version: "encryptionkey@0"
I20260808 08:38:39.182859 24432 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:38:39.186336 24450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:39.187691 24432 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:38:39.187875 24432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d"
format_stamp: "Formatted at 2026-08-08 08:38:39 on dist-test-slave-chsk"
server_key: "bcd743ba1a0641d50e8f45d0b62af749"
server_key_iv: "81f121cf51e6ef354744e45241d26ab5"
server_key_version: "encryptionkey@0"
I20260808 08:38:39.188076 24432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:39.211238 24432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:39.215405 24432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:39.215716 24432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:39.216737 24432 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:39.218107 24432 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:39.218181 24432 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:39.218331 24432 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:39.218415 24432 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:39.252671 24432 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:36741
I20260808 08:38:39.252774 24568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:36741 every 8 connection(s)
I20260808 08:38:39.254033 24432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:38:39.254565 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 24432
I20260808 08:38:39.254801 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:38:39.255707 5779 external_mini_cluster.cc:1428] Setting key 96fd6990302c6bff24a56ffa9c00dd63
Aug 08 08:38:39 dist-test-slave-chsk krb5kdc[24320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178319, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:38:39.274835 24571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:39.256988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:46245 (local address 127.5.164.254:45281)
0808 08:38:39.257513 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:39.257519 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:39.258660 (+ 1141us) server_negotiation.cc:407] Connection header received
0808 08:38:39.260628 (+ 1968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:39.260634 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:39.260719 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:39.260847 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:39.262396 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:39.263193 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:39.264763 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:39.265183 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:39.265326 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:39.269064 (+ 3738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:39.269069 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:39.269072 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:39.269104 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:39.271718 (+ 2614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:39.272455 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:39.272462 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:39.272465 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:39.272600 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:39.273051 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:39.273062 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:39.273065 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:39.273326 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:39.273489 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:39.274213 (+ 724us) server_negotiation.cc:299] Negotiation successful
0808 08:38:39.274447 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":257,"threads_started":1}
I20260808 08:38:39.275846 24572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:39.257652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:45281 (local address 127.5.164.193:46245)
0808 08:38:39.258502 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:39.258540 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:39.260358 (+ 1818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:39.261105 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:39.261113 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:39.261636 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:39.262221 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:39.262239 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:39.263370 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:39.263380 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:39.264613 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:39.264626 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:39.265424 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:39.265432 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:39.265671 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:39.266400 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:38:39.266421 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:39.268840 (+ 2419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:39.271860 (+ 3020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:39.271869 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:39.271885 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:39.272329 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:39.272716 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:39.272721 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:39.272724 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:39.272913 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:39.273469 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:39.273477 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:39.273808 (+ 331us) client_negotiation.cc:769] Sending connection context
0808 08:38:39.274084 (+ 276us) client_negotiation.cc:240] Negotiation successful
0808 08:38:39.274611 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":394,"threads_started":1}
I20260808 08:38:39.277551 24569 heartbeater.cc:347] Connected to a master server at 127.5.164.254:45281
I20260808 08:38:39.277866 24569 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:39.278597 24569 heartbeater.cc:511] Master 127.5.164.254:45281 requested a full tablet report, sending...
I20260808 08:38:39.280943 24367 ts_manager.cc:194] Registered new tserver with Master: 17c5f3b2fd6648aebb42ad9bd1a88e0d (127.5.164.193:36741)
I20260808 08:38:39.283186 24367 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:46245
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:38:39.331365 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45281
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:38:39.695536 24575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:39.695859 24575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:39.695960 24575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:39.703846 24575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:39.703981 24575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:39.704099 24575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:38:39.714989 24575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45281
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:39.716354 24575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:39.717788 24575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:39.734933 24580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:39.736001 24581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:39.737545 24583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:39.738121 24575 server_base.cc:1034] running on GCE node
I20260808 08:38:39.739262 24575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:39.740538 24575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:39.741775 24575 hybrid_clock.cc:648] HybridClock initialized: now 1786178319741720 us; error 55 us; skew 500 ppm
I20260808 08:38:39.742133 24575 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:38:39 dist-test-slave-chsk krb5kdc[24320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178319, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:38:39.745630 24575 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:38:39.747444 24575 webserver.cc:460] Webserver started at http://127.5.164.194:38159/ using document root <none> and password file <none>
I20260808 08:38:39.748159 24575 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:39.748277 24575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:39.748553 24575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:39.751704 24575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "29c4172640ac4f0494af8018c68875b2"
format_stamp: "Formatted at 2026-08-08 08:38:39 on dist-test-slave-chsk"
server_key: "27b7ffaa83b691402a571dc610adfc72"
server_key_iv: "ac0ef91b04d975e7b06b213bc9be8510"
server_key_version: "encryptionkey@0"
I20260808 08:38:39.752512 24575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "29c4172640ac4f0494af8018c68875b2"
format_stamp: "Formatted at 2026-08-08 08:38:39 on dist-test-slave-chsk"
server_key: "27b7ffaa83b691402a571dc610adfc72"
server_key_iv: "ac0ef91b04d975e7b06b213bc9be8510"
server_key_version: "encryptionkey@0"
I20260808 08:38:39.758213 24575 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 08:38:39.762069 24590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:39.763609 24575 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:38:39.763813 24575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "29c4172640ac4f0494af8018c68875b2"
format_stamp: "Formatted at 2026-08-08 08:38:39 on dist-test-slave-chsk"
server_key: "27b7ffaa83b691402a571dc610adfc72"
server_key_iv: "ac0ef91b04d975e7b06b213bc9be8510"
server_key_version: "encryptionkey@0"
I20260808 08:38:39.764041 24575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:39.781435 24575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:39.786388 24575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:39.786720 24575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:39.787858 24575 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:39.789350 24575 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:39.789463 24575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:39.789621 24575 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:39.789696 24575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:39.827245 24575 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:38451
I20260808 08:38:39.827296 24708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:38451 every 8 connection(s)
I20260808 08:38:39.828650 24575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:38:39.836445 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 24575
I20260808 08:38:39.836680 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:38:39.837121 5779 external_mini_cluster.cc:1428] Setting key 0d9dd580a99cbb6a007d37ec3a87d658
Aug 08 08:38:39 dist-test-slave-chsk krb5kdc[24320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178319, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:38:39.850087 24711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:39.831419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:33859 (local address 127.5.164.254:45281)
0808 08:38:39.831903 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:39.831907 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:39.832833 (+ 926us) server_negotiation.cc:407] Connection header received
0808 08:38:39.834802 (+ 1969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:39.834807 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:39.834903 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:39.835026 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:39.836681 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:39.837494 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:39.839094 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:39.839586 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:39.839731 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:39.843771 (+ 4040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:39.843776 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:39.843779 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:39.843814 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:39.846616 (+ 2802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:39.847562 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:39.847567 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:39.847569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:39.847710 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:39.848204 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:39.848208 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:39.848210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:39.848497 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:39.848666 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:39.849430 (+ 764us) server_negotiation.cc:299] Negotiation successful
0808 08:38:39.849685 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":257,"threads_started":1}
I20260808 08:38:39.851219 24712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:39.831861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:45281 (local address 127.5.164.194:33859)
0808 08:38:39.832647 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:39.832687 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:39.834496 (+ 1809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:39.835322 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:39.835330 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:39.835876 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:39.836483 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:39.836500 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:39.837663 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:39.837667 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:39.838924 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:39.838936 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:39.839840 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:39.839847 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:39.840099 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:39.840841 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:38:39.840865 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:39.843481 (+ 2616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:39.846808 (+ 3327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:39.846818 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:39.846837 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:39.847412 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:39.847832 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:39.847837 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:39.847841 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:39.848058 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:39.848635 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:39.848644 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:39.849028 (+ 384us) client_negotiation.cc:769] Sending connection context
0808 08:38:39.849323 (+ 295us) client_negotiation.cc:240] Negotiation successful
0808 08:38:39.849930 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":333,"threads_started":1}
I20260808 08:38:39.852826 24709 heartbeater.cc:347] Connected to a master server at 127.5.164.254:45281
I20260808 08:38:39.853180 24709 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:39.854230 24709 heartbeater.cc:511] Master 127.5.164.254:45281 requested a full tablet report, sending...
I20260808 08:38:39.856092 24367 ts_manager.cc:194] Registered new tserver with Master: 29c4172640ac4f0494af8018c68875b2 (127.5.164.194:38451)
I20260808 08:38:39.857519 24367 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:33859
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:38:39.914083 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45281
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:38:40.265393 24715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:40.265735 24715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:40.265905 24715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:40.273527 24715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:40.273703 24715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:40.273883 24715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:38:40.283991 24715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45281
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:40.285367 24715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:40.286620 24569 heartbeater.cc:503] Master 127.5.164.254:45281 was elected leader, sending a full tablet report...
I20260808 08:38:40.286913 24715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:40.300549 24721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:40.300567 24720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:40.300633 24724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:40.301242 24715 server_base.cc:1034] running on GCE node
I20260808 08:38:40.301908 24715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:40.302903 24715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:40.304181 24715 hybrid_clock.cc:648] HybridClock initialized: now 1786178320304111 us; error 69 us; skew 500 ppm
I20260808 08:38:40.304615 24715 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:38:40 dist-test-slave-chsk krb5kdc[24320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178320, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:38:40.308019 24715 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:38:40.309672 24715 webserver.cc:460] Webserver started at http://127.5.164.195:43597/ using document root <none> and password file <none>
I20260808 08:38:40.310622 24715 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:40.310782 24715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:40.311133 24715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:40.314298 24715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "d2003df7b9b44cc78ca771ee2c063952"
format_stamp: "Formatted at 2026-08-08 08:38:40 on dist-test-slave-chsk"
server_key: "f60611a3b14ba92584cd41a6f2ffed02"
server_key_iv: "5486d2052bf1ddb62bc35e0f3ac6aaa0"
server_key_version: "encryptionkey@0"
I20260808 08:38:40.315124 24715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "d2003df7b9b44cc78ca771ee2c063952"
format_stamp: "Formatted at 2026-08-08 08:38:40 on dist-test-slave-chsk"
server_key: "f60611a3b14ba92584cd41a6f2ffed02"
server_key_iv: "5486d2052bf1ddb62bc35e0f3ac6aaa0"
server_key_version: "encryptionkey@0"
I20260808 08:38:40.320488 24715 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 08:38:40.324055 24731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:40.325340 24715 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:38:40.325524 24715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "d2003df7b9b44cc78ca771ee2c063952"
format_stamp: "Formatted at 2026-08-08 08:38:40 on dist-test-slave-chsk"
server_key: "f60611a3b14ba92584cd41a6f2ffed02"
server_key_iv: "5486d2052bf1ddb62bc35e0f3ac6aaa0"
server_key_version: "encryptionkey@0"
I20260808 08:38:40.325730 24715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:40.356140 24715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:40.360348 24715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:40.360656 24715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:40.361667 24715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:40.363049 24715 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:40.363122 24715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:40.363317 24715 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:40.363377 24715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:40.398313 24715 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:39997
I20260808 08:38:40.398371 24849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:39997 every 8 connection(s)
I20260808 08:38:40.399713 24715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:38:40.407897 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 24715
I20260808 08:38:40.408103 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:38:40.408617 5779 external_mini_cluster.cc:1428] Setting key dc2c3b899b61830faee76b8cd8d5c728
Aug 08 08:38:40 dist-test-slave-chsk krb5kdc[24320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178320, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:38:40.421326 24852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:40.402363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:55001 (local address 127.5.164.254:45281)
0808 08:38:40.402896 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:40.402903 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:40.403952 (+ 1049us) server_negotiation.cc:407] Connection header received
0808 08:38:40.405894 (+ 1942us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:40.405899 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:40.405985 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:40.406085 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:40.407668 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.408613 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.410997 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.411655 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.411793 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:40.415601 (+ 3808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:40.415606 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:40.415609 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:40.415643 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:40.418328 (+ 2685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:40.419082 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:40.419087 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:40.419089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:40.419307 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:40.419722 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:40.419725 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:40.419727 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:40.420000 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:40.420122 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:40.420845 (+ 723us) server_negotiation.cc:299] Negotiation successful
0808 08:38:40.421026 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":246,"threads_started":1}
I20260808 08:38:40.422257 24853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:40.402891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:45281 (local address 127.5.164.195:55001)
0808 08:38:40.403788 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:40.403828 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:40.405626 (+ 1798us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:40.406293 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:40.406302 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:40.406828 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:40.407477 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:40.407504 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.408901 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.408907 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:40.410830 (+ 1923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:40.410843 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.411879 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.411884 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:40.412213 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:40.412974 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:38:40.412998 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:40.415386 (+ 2388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:40.418477 (+ 3091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:40.418485 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:40.418499 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:40.418965 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:40.419414 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:40.419418 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:40.419420 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:40.419614 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:40.420109 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:40.420115 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:40.420457 (+ 342us) client_negotiation.cc:769] Sending connection context
0808 08:38:40.420689 (+ 232us) client_negotiation.cc:240] Negotiation successful
0808 08:38:40.421101 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":429,"threads_started":1}
I20260808 08:38:40.424023 24850 heartbeater.cc:347] Connected to a master server at 127.5.164.254:45281
I20260808 08:38:40.424377 24850 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:40.425120 24850 heartbeater.cc:511] Master 127.5.164.254:45281 requested a full tablet report, sending...
I20260808 08:38:40.426613 24366 ts_manager.cc:194] Registered new tserver with Master: d2003df7b9b44cc78ca771ee2c063952 (127.5.164.195:39997)
I20260808 08:38:40.427589 24366 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:55001
I20260808 08:38:40.437605 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:38:40.456674 24852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:40.442585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57734 (local address 127.5.164.254:45281)
0808 08:38:40.442780 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:40.442786 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:40.443393 (+ 607us) server_negotiation.cc:407] Connection header received
0808 08:38:40.443524 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:40.443529 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:40.443619 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:40.443714 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:40.445250 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.446027 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.447519 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.447969 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.448076 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:40.450835 (+ 2759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:40.450841 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:40.450844 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:40.450884 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:40.453875 (+ 2991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:40.454681 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:40.454685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:40.454687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:40.454812 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:40.455321 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:40.455324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:40.455326 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:40.455683 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:40.455889 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:40.456244 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 08:38:40.456430 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:38:40.461335 24366 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57734:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:38:40.468456 24366 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:38:40.505389 24864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:40.481760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42598 (local address 127.5.164.193:36741)
0808 08:38:40.492086 (+ 10326us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:40.492099 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:40.495420 (+ 3321us) server_negotiation.cc:407] Connection header received
0808 08:38:40.495704 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:40.495714 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:40.495997 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:40.496272 (+ 275us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:40.497822 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.499496 (+ 1674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.502461 (+ 2965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.503955 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.504046 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:40.504224 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:40.504838 (+ 614us) server_negotiation.cc:299] Negotiation successful
0808 08:38:40.505031 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10109,"thread_start_us":9926,"threads_started":1}
I20260808 08:38:40.505836 24867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:40.481962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:38451 (local address 127.0.0.1:60326)
0808 08:38:40.497094 (+ 15132us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:40.497135 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:40.497261 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:40.498116 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:40.498121 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:40.498151 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:40.498549 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:40.498558 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.500485 (+ 1927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.500490 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:40.502803 (+ 2313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:40.502819 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.504818 (+ 1999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.504825 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:40.505035 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:40.505072 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:38:40.505169 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 08:38:40.505387 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14980,"mutex_wait_us":61,"thread_start_us":13024,"threads_started":1}
I20260808 08:38:40.505988 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:40.483215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54784 (local address 127.5.164.195:39997)
0808 08:38:40.496147 (+ 12932us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:40.496153 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:40.498348 (+ 2195us) server_negotiation.cc:407] Connection header received
0808 08:38:40.498450 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:40.498457 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:40.498668 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:40.498854 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:40.499498 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.500667 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.503268 (+ 2601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.504714 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.504840 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:40.505033 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:40.505442 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 08:38:40.505624 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12787,"thread_start_us":12609,"threads_started":1}
I20260808 08:38:40.506299 24865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:40.481548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:36741 (local address 127.0.0.1:42598)
0808 08:38:40.495245 (+ 13697us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:40.495290 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:40.495492 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:40.496296 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:40.496308 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:40.496349 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:40.497595 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:40.497614 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.499646 (+ 2032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.499651 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:40.502263 (+ 2612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:40.502279 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.504407 (+ 2128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.504412 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:40.504548 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:40.504587 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 08:38:40.505693 (+ 1106us) client_negotiation.cc:240] Negotiation successful
0808 08:38:40.505880 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13417,"mutex_wait_us":1,"thread_start_us":16280,"threads_started":1}
I20260808 08:38:40.506634 24863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:40.482476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:39997 (local address 127.0.0.1:54784)
0808 08:38:40.498121 (+ 15645us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:40.498139 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:40.498288 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:40.498868 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:40.498873 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:40.498900 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:40.499309 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:40.499324 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.500821 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.500827 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:40.503072 (+ 2245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:40.503088 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.505122 (+ 2034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.505127 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:40.505251 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:40.505276 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:38:40.505376 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 08:38:40.505825 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15493,"mutex_wait_us":2,"spinlock_wait_cycles":1280,"thread_start_us":13856,"threads_started":1}
I20260808 08:38:40.506747 24866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:40.482365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60326 (local address 127.5.164.194:38451)
0808 08:38:40.494669 (+ 12304us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:40.494678 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:40.497398 (+ 2720us) server_negotiation.cc:407] Connection header received
0808 08:38:40.497513 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:40.497520 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:40.497860 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:40.498066 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:40.498721 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.500321 (+ 1600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.502975 (+ 2654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.504562 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.504725 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:40.504943 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:40.506231 (+ 1288us) server_negotiation.cc:299] Negotiation successful
0808 08:38:40.506419 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12109,"thread_start_us":13290,"threads_started":1}
I20260808 08:38:40.510506 24501 tablet_service.cc:1467] Processing CreateTablet for tablet 3b99c083f07d4fd5b36bcea07af43d2f (DEFAULT_TABLE table=test-table [id=5c8036a1de4549adb5a922be40c56ab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:40.510459 24643 tablet_service.cc:1467] Processing CreateTablet for tablet 3b99c083f07d4fd5b36bcea07af43d2f (DEFAULT_TABLE table=test-table [id=5c8036a1de4549adb5a922be40c56ab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:40.510463 24784 tablet_service.cc:1467] Processing CreateTablet for tablet 3b99c083f07d4fd5b36bcea07af43d2f (DEFAULT_TABLE table=test-table [id=5c8036a1de4549adb5a922be40c56ab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:40.511894 24501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b99c083f07d4fd5b36bcea07af43d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:40.511963 24784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b99c083f07d4fd5b36bcea07af43d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:40.511963 24643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b99c083f07d4fd5b36bcea07af43d2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:40.523648 24869 tablet_bootstrap.cc:492] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d: Bootstrap starting.
I20260808 08:38:40.526892 24870 tablet_bootstrap.cc:492] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952: Bootstrap starting.
I20260808 08:38:40.529014 24869 tablet_bootstrap.cc:654] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:40.530408 24869 log.cc:824] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:40.530700 24870 tablet_bootstrap.cc:654] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:40.532056 24870 log.cc:824] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:40.532110 24871 tablet_bootstrap.cc:492] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2: Bootstrap starting.
I20260808 08:38:40.533846 24869 tablet_bootstrap.cc:492] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d: No bootstrap required, opened a new log
I20260808 08:38:40.534132 24869 ts_tablet_manager.cc:1397] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.002s
I20260808 08:38:40.537070 24871 tablet_bootstrap.cc:654] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:40.538682 24871 log.cc:824] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:40.541414 24870 tablet_bootstrap.cc:492] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952: No bootstrap required, opened a new log
I20260808 08:38:40.541698 24870 ts_tablet_manager.cc:1397] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.000s
I20260808 08:38:40.542405 24869 raft_consensus.cc:348] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36741 } } peers { permanent_uuid: "29c4172640ac4f0494af8018c68875b2" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38451 } } peers { permanent_uuid: "d2003df7b9b44cc78ca771ee2c063952" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 39997 } }
I20260808 08:38:40.542784 24869 raft_consensus.cc:374] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:40.542903 24869 raft_consensus.cc:729] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17c5f3b2fd6648aebb42ad9bd1a88e0d, State: Initialized, Role: FOLLOWER
I20260808 08:38:40.543596 24869 consensus_queue.cc:260] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36741 } } peers { permanent_uuid: "29c4172640ac4f0494af8018c68875b2" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38451 } } peers { permanent_uuid: "d2003df7b9b44cc78ca771ee2c063952" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 39997 } }
I20260808 08:38:40.544742 24871 tablet_bootstrap.cc:492] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2: No bootstrap required, opened a new log
I20260808 08:38:40.545018 24871 ts_tablet_manager.cc:1397] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.007s
I20260808 08:38:40.545557 24869 ts_tablet_manager.cc:1428] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260808 08:38:40.551858 24870 raft_consensus.cc:348] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36741 } } peers { permanent_uuid: "29c4172640ac4f0494af8018c68875b2" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38451 } } peers { permanent_uuid: "d2003df7b9b44cc78ca771ee2c063952" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 39997 } }
I20260808 08:38:40.552295 24870 raft_consensus.cc:374] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:40.552394 24870 raft_consensus.cc:729] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2003df7b9b44cc78ca771ee2c063952, State: Initialized, Role: FOLLOWER
I20260808 08:38:40.553033 24870 consensus_queue.cc:260] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36741 } } peers { permanent_uuid: "29c4172640ac4f0494af8018c68875b2" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38451 } } peers { permanent_uuid: "d2003df7b9b44cc78ca771ee2c063952" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 39997 } }
I20260808 08:38:40.554343 24850 heartbeater.cc:503] Master 127.5.164.254:45281 was elected leader, sending a full tablet report...
I20260808 08:38:40.554858 24870 ts_tablet_manager.cc:1428] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260808 08:38:40.554543 24871 raft_consensus.cc:348] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36741 } } peers { permanent_uuid: "29c4172640ac4f0494af8018c68875b2" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38451 } } peers { permanent_uuid: "d2003df7b9b44cc78ca771ee2c063952" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 39997 } }
I20260808 08:38:40.554991 24871 raft_consensus.cc:374] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:40.555109 24871 raft_consensus.cc:729] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c4172640ac4f0494af8018c68875b2, State: Initialized, Role: FOLLOWER
I20260808 08:38:40.555778 24871 consensus_queue.cc:260] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36741 } } peers { permanent_uuid: "29c4172640ac4f0494af8018c68875b2" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38451 } } peers { permanent_uuid: "d2003df7b9b44cc78ca771ee2c063952" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 39997 } }
I20260808 08:38:40.556984 24709 heartbeater.cc:503] Master 127.5.164.254:45281 was elected leader, sending a full tablet report...
I20260808 08:38:40.557488 24871 ts_tablet_manager.cc:1428] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2: Time spent starting tablet: real 0.012s user 0.010s sys 0.003s
W20260808 08:38:40.580785 24710 tablet.cc:2369] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:38:40.651552 24851 tablet.cc:2369] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:38:40.707494 24875 raft_consensus.cc:482] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:38:40.707798 24875 raft_consensus.cc:504] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36741 } } peers { permanent_uuid: "29c4172640ac4f0494af8018c68875b2" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38451 } } peers { permanent_uuid: "d2003df7b9b44cc78ca771ee2c063952" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 39997 } }
I20260808 08:38:40.709897 24875 leader_election.cc:288] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29c4172640ac4f0494af8018c68875b2 (127.5.164.194:38451), d2003df7b9b44cc78ca771ee2c063952 (127.5.164.195:39997)
I20260808 08:38:40.719453 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:40.710405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:57889 (local address 127.5.164.195:39997)
0808 08:38:40.710721 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:40.710744 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:40.711316 (+ 572us) server_negotiation.cc:407] Connection header received
0808 08:38:40.711569 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:40.711575 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:40.711670 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:40.711783 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:40.712521 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.713684 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.716914 (+ 3230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.718210 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.718398 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:40.718463 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:40.718997 (+ 534us) server_negotiation.cc:299] Negotiation successful
0808 08:38:40.719135 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260808 08:38:40.719453 24866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:40.710450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:52933 (local address 127.5.164.194:38451)
0808 08:38:40.710950 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:40.710959 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:40.711558 (+ 599us) server_negotiation.cc:407] Connection header received
0808 08:38:40.711748 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:40.711756 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:40.711838 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:40.711931 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:40.712644 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.713695 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.716914 (+ 3219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.718194 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.718381 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:40.718463 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:40.718997 (+ 534us) server_negotiation.cc:299] Negotiation successful
0808 08:38:40.719135 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322}
I20260808 08:38:40.719695 24879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:40.710466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:38451 (local address 127.5.164.193:52933)
0808 08:38:40.711443 (+ 977us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:40.711467 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:40.711585 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:40.711970 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:40.711976 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:40.712015 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:40.712465 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:40.712478 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.713847 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.713853 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:40.716715 (+ 2862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:40.716731 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.718537 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.718550 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:40.718757 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:40.718851 (+ 94us) client_negotiation.cc:769] Sending connection context
0808 08:38:40.718953 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 08:38:40.719110 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":861,"mutex_wait_us":294,"thread_start_us":681,"threads_started":1}
I20260808 08:38:40.719719 24878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:40.710199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:39997 (local address 127.5.164.193:57889)
0808 08:38:40.711129 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:40.711186 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:40.711382 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:40.711829 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:40.711833 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:40.711854 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:40.712347 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:40.712359 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.713847 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.713853 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:40.716712 (+ 2859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:40.716731 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.718515 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.718523 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:40.718757 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:40.718848 (+ 91us) client_negotiation.cc:769] Sending connection context
0808 08:38:40.718953 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 08:38:40.719111 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":744,"mutex_wait_us":212,"thread_start_us":549,"threads_started":1}
I20260808 08:38:40.720788 24804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b99c083f07d4fd5b36bcea07af43d2f" candidate_uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2003df7b9b44cc78ca771ee2c063952" is_pre_election: true
I20260808 08:38:40.720834 24664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b99c083f07d4fd5b36bcea07af43d2f" candidate_uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c4172640ac4f0494af8018c68875b2" is_pre_election: true
I20260808 08:38:40.721351 24804 raft_consensus.cc:2454] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c5f3b2fd6648aebb42ad9bd1a88e0d in term 0.
I20260808 08:38:40.721405 24664 raft_consensus.cc:2454] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 17c5f3b2fd6648aebb42ad9bd1a88e0d in term 0.
I20260808 08:38:40.722193 24453 leader_election.cc:302] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c5f3b2fd6648aebb42ad9bd1a88e0d, 29c4172640ac4f0494af8018c68875b2; no voters:
I20260808 08:38:40.722700 24875 raft_consensus.cc:2781] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:38:40.722899 24875 raft_consensus.cc:482] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:38:40.723030 24875 raft_consensus.cc:3037] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:40.725427 24875 raft_consensus.cc:504] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36741 } } peers { permanent_uuid: "29c4172640ac4f0494af8018c68875b2" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38451 } } peers { permanent_uuid: "d2003df7b9b44cc78ca771ee2c063952" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 39997 } }
I20260808 08:38:40.726122 24875 leader_election.cc:288] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [CANDIDATE]: Term 1 election: Requested vote from peers 29c4172640ac4f0494af8018c68875b2 (127.5.164.194:38451), d2003df7b9b44cc78ca771ee2c063952 (127.5.164.195:39997)
I20260808 08:38:40.726722 24804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b99c083f07d4fd5b36bcea07af43d2f" candidate_uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2003df7b9b44cc78ca771ee2c063952"
I20260808 08:38:40.726722 24664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b99c083f07d4fd5b36bcea07af43d2f" candidate_uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29c4172640ac4f0494af8018c68875b2"
I20260808 08:38:40.726962 24804 raft_consensus.cc:3037] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:40.726962 24664 raft_consensus.cc:3037] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:40.730484 24804 raft_consensus.cc:2454] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c5f3b2fd6648aebb42ad9bd1a88e0d in term 1.
I20260808 08:38:40.730475 24664 raft_consensus.cc:2454] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17c5f3b2fd6648aebb42ad9bd1a88e0d in term 1.
I20260808 08:38:40.731025 24452 leader_election.cc:302] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17c5f3b2fd6648aebb42ad9bd1a88e0d, d2003df7b9b44cc78ca771ee2c063952; no voters:
I20260808 08:38:40.731426 24875 raft_consensus.cc:2781] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:38:40.731858 24875 raft_consensus.cc:686] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [term 1 LEADER]: Becoming Leader. State: Replica: 17c5f3b2fd6648aebb42ad9bd1a88e0d, State: Running, Role: LEADER
I20260808 08:38:40.732370 24875 consensus_queue.cc:237] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36741 } } peers { permanent_uuid: "29c4172640ac4f0494af8018c68875b2" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38451 } } peers { permanent_uuid: "d2003df7b9b44cc78ca771ee2c063952" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 39997 } }
I20260808 08:38:40.737383 24366 catalog_manager.cc:5495] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 17c5f3b2fd6648aebb42ad9bd1a88e0d (127.5.164.193). New cstate: current_term: 1 leader_uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17c5f3b2fd6648aebb42ad9bd1a88e0d" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 36741 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29c4172640ac4f0494af8018c68875b2" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2003df7b9b44cc78ca771ee2c063952" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 39997 } health_report { overall_health: UNKNOWN } } }
W20260808 08:38:40.756873 24570 tablet.cc:2369] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:38:40.793542 24864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:40.787481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42604 (local address 127.5.164.193:36741)
0808 08:38:40.787716 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:40.787721 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:40.787739 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:38:40.787973 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:40.787978 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:40.788080 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:40.788241 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:38:40.788606 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.789404 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.790863 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.791486 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.791604 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:40.792208 (+ 604us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:38:40.792800 (+ 592us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:38:40.792914 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:40.793093 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 08:38:40.793167 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 08:38:40.802237 24804 raft_consensus.cc:1261] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952 [term 1 FOLLOWER]: Refusing update from remote peer 17c5f3b2fd6648aebb42ad9bd1a88e0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:38:40.802248 24664 raft_consensus.cc:1261] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2 [term 1 FOLLOWER]: Refusing update from remote peer 17c5f3b2fd6648aebb42ad9bd1a88e0d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:38:40.803293 24880 consensus_queue.cc:1035] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2003df7b9b44cc78ca771ee2c063952" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 39997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:38:40.803707 24875 consensus_queue.cc:1035] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "29c4172640ac4f0494af8018c68875b2" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:38:40.815835 24883 mvcc.cc:205] Tried to move back new op lower bound from 7316186401995702272 to 7316186401723699200. Current Snapshot: MvccSnapshot[applied={T|T < 7316186401995702272}]
I20260808 08:38:40.832283 24367 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57734:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:38:40.832595 24367 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57734:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:38:40.836916 24367 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 414dccd3f3a541ee88e716df919f0387: Sending DeleteTablet for 3 replicas of tablet 3b99c083f07d4fd5b36bcea07af43d2f
I20260808 08:38:40.838042 24501 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b99c083f07d4fd5b36bcea07af43d2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:40 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:42598
I20260808 08:38:40.838049 24643 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b99c083f07d4fd5b36bcea07af43d2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:40 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:60326
I20260808 08:38:40.839020 24894 tablet_replica.cc:330] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d: stopping tablet replica
I20260808 08:38:40.839258 24784 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b99c083f07d4fd5b36bcea07af43d2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:40 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:54784
I20260808 08:38:40.839654 24894 raft_consensus.cc:2229] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:38:40.840735 24894 raft_consensus.cc:2258] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:38:40.841327 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 24432
I20260808 08:38:40.842931 24894 ts_tablet_manager.cc:1905] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:38:40.850934 24894 ts_tablet_manager.cc:1918] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:40.851272 24894 log.cc:1196] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/3b99c083f07d4fd5b36bcea07af43d2f
I20260808 08:38:40.851985 24894 ts_tablet_manager.cc:1939] T 3b99c083f07d4fd5b36bcea07af43d2f P 17c5f3b2fd6648aebb42ad9bd1a88e0d: Deleting consensus metadata
I20260808 08:38:40.854094 24351 catalog_manager.cc:4841] TS 17c5f3b2fd6648aebb42ad9bd1a88e0d (127.5.164.193:36741): tablet 3b99c083f07d4fd5b36bcea07af43d2f (table test-table [id=5c8036a1de4549adb5a922be40c56ab9]) successfully deleted
I20260808 08:38:40.856244 24896 tablet_replica.cc:330] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952: stopping tablet replica
I20260808 08:38:40.857331 24895 tablet_replica.cc:330] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2: stopping tablet replica
I20260808 08:38:40.857821 24895 raft_consensus.cc:2229] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:38:40.857859 24896 raft_consensus.cc:2229] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:38:40.858399 24895 raft_consensus.cc:2258] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:38:40.859655 24896 raft_consensus.cc:2258] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:38:40.861959 24896 ts_tablet_manager.cc:1905] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 08:38:40 dist-test-slave-chsk krb5kdc[24320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:38:40.868985 24896 ts_tablet_manager.cc:1918] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:40.869169 24896 log.cc:1196] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/3b99c083f07d4fd5b36bcea07af43d2f
I20260808 08:38:40.869722 24896 ts_tablet_manager.cc:1939] T 3b99c083f07d4fd5b36bcea07af43d2f P d2003df7b9b44cc78ca771ee2c063952: Deleting consensus metadata
I20260808 08:38:40.872247 24895 ts_tablet_manager.cc:1905] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:38:40.877290 24864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:40.842691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42614 (local address 127.5.164.193:36741)
0808 08:38:40.842926 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:40.842935 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:40.856579 (+ 13644us) server_negotiation.cc:407] Connection header received
0808 08:38:40.856815 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:40.856823 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:40.856918 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:40.857034 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:40.858963 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.860304 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.862374 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:40.863059 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:40.863244 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:40.869128 (+ 5884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:40.869149 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:40.869170 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:40.869229 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:40.873502 (+ 4273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:40.874436 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:40.874445 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:40.874448 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:40.874670 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:40.875176 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:40.875181 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:40.875183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:40.875703 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:40.876014 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:40.876422 (+ 408us) server_negotiation.cc:299] Negotiation successful
0808 08:38:40.876676 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:38:40.878042 24564 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:40.879071 24895 ts_tablet_manager.cc:1918] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:40.879120 24352 catalog_manager.cc:4841] TS d2003df7b9b44cc78ca771ee2c063952 (127.5.164.195:39997): tablet 3b99c083f07d4fd5b36bcea07af43d2f (table test-table [id=5c8036a1de4549adb5a922be40c56ab9]) successfully deleted
I20260808 08:38:40.879298 24895 log.cc:1196] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/3b99c083f07d4fd5b36bcea07af43d2f
I20260808 08:38:40.879966 24895 ts_tablet_manager.cc:1939] T 3b99c083f07d4fd5b36bcea07af43d2f P 29c4172640ac4f0494af8018c68875b2: Deleting consensus metadata
I20260808 08:38:40.882047 24353 catalog_manager.cc:4841] TS 29c4172640ac4f0494af8018c68875b2 (127.5.164.194:38451): tablet 3b99c083f07d4fd5b36bcea07af43d2f (table test-table [id=5c8036a1de4549adb5a922be40c56ab9]) successfully deleted
I20260808 08:38:40.982174 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 24432
I20260808 08:38:41.005146 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 24575
Aug 08 08:38:41 dist-test-slave-chsk krb5kdc[24320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:38:41.020992 24866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:41.005986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60328 (local address 127.5.164.194:38451)
0808 08:38:41.006178 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:41.006183 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:41.006202 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:38:41.006342 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:41.006346 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:41.006427 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:41.006511 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:41.007990 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:41.008869 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:41.010258 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:41.010753 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:41.010878 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:41.015198 (+ 4320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:41.015213 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:41.015229 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:41.015263 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:41.018115 (+ 2852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:41.018758 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:41.018765 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:41.018767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:41.018888 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:41.019564 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:41.019567 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:41.019570 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:41.019958 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:41.020196 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:41.020436 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 08:38:41.020600 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:38:41.021710 24704 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:41.113253 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 24575
I20260808 08:38:41.134106 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 24715
Aug 08 08:38:41 dist-test-slave-chsk krb5kdc[24320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:38:41.149852 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:41.134933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54788 (local address 127.5.164.195:39997)
0808 08:38:41.135180 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:41.135193 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:41.135214 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:38:41.135337 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:41.135341 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:41.135408 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:41.135491 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:41.136823 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:41.137530 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:41.138824 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:41.139370 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:41.139467 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:41.144083 (+ 4616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:41.144106 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:41.144123 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:41.144169 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:41.146853 (+ 2684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:41.147673 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:41.147680 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:41.147682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:41.147835 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:41.148247 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:41.148251 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:41.148253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:41.148614 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:41.148917 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:41.149250 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 08:38:41.149482 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:38:41.150545 24845 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:41.240907 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 24715
I20260808 08:38:41.261560 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 24335
I20260808 08:38:41.262806 24398 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:41.378160 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 24335
2026-08-08T08:38:41Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4821 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T08:38:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:38:41Z Disabled control of system clock
I20260808 08:38:41.479487 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:42809
--webserver_interface=127.5.164.254
--webserver_port=0
--builtin_ntp_servers=127.5.164.212:34501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:42809
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:38:41.830333 24905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:41.830634 24905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:41.830806 24905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:41.838182 24905 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:38:41.838299 24905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:41.838388 24905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:41.838495 24905 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:38:41.838550 24905 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:38:41.848728 24905 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:42809
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:42809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:41.850229 24905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:41.852129 24905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:41.864377 24910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:41.864485 24913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:41.864437 24911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:41.864935 24905 server_base.cc:1034] running on GCE node
I20260808 08:38:41.865828 24905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:41.867302 24905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:41.868534 24905 hybrid_clock.cc:648] HybridClock initialized: now 1786178321868480 us; error 45 us; skew 500 ppm
I20260808 08:38:41.868899 24905 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:38:41.871219 24905 webserver.cc:460] Webserver started at http://127.5.164.254:40123/ using document root <none> and password file <none>
I20260808 08:38:41.871917 24905 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:41.872048 24905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:41.872376 24905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:41.875336 24905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "f83bd6621752437e9b5730be7a5aa6e2"
format_stamp: "Formatted at 2026-08-08 08:38:41 on dist-test-slave-chsk"
server_key: "34339ea83bfc2cbb4ca5d733d2d10e72"
server_key_iv: "feaf0e1a04b403b7056653a7187276aa"
server_key_version: "encryptionkey@0"
I20260808 08:38:41.876144 24905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "f83bd6621752437e9b5730be7a5aa6e2"
format_stamp: "Formatted at 2026-08-08 08:38:41 on dist-test-slave-chsk"
server_key: "34339ea83bfc2cbb4ca5d733d2d10e72"
server_key_iv: "feaf0e1a04b403b7056653a7187276aa"
server_key_version: "encryptionkey@0"
I20260808 08:38:41.881296 24905 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260808 08:38:41.884812 24922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:41.886106 24905 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:38:41.886307 24905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "f83bd6621752437e9b5730be7a5aa6e2"
format_stamp: "Formatted at 2026-08-08 08:38:41 on dist-test-slave-chsk"
server_key: "34339ea83bfc2cbb4ca5d733d2d10e72"
server_key_iv: "feaf0e1a04b403b7056653a7187276aa"
server_key_version: "encryptionkey@0"
I20260808 08:38:41.886531 24905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:41.915057 24905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:41.916019 24905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:41.916342 24905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:41.935432 24905 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:42809
I20260808 08:38:41.935456 24977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:42809 every 8 connection(s)
I20260808 08:38:41.936836 24905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:38:41.940725 24978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:41.941279 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 24905
I20260808 08:38:41.941486 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:38:41.942116 5779 external_mini_cluster.cc:1428] Setting key 1e19b48211d60691668ffd19f8fb2458
I20260808 08:38:41.955130 24978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2: Bootstrap starting.
I20260808 08:38:41.956768 24981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:41.944169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56064 (local address 127.5.164.254:42809)
0808 08:38:41.945279 (+ 1110us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:41.945289 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:41.945330 (+ 41us) server_negotiation.cc:407] Connection header received
0808 08:38:41.947351 (+ 2021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:41.947373 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:41.947907 (+ 534us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:41.948253 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:41.948891 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:41.950140 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:41.952141 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:41.952858 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:41.952986 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:41.954324 (+ 1338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:41.954332 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:41.954345 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:41.954888 (+ 543us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:41.954962 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:41.954982 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:41.955072 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:41.955440 (+ 368us) server_negotiation.cc:299] Negotiation successful
0808 08:38:41.955795 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":484,"threads_started":1}
I20260808 08:38:41.958523 24978 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:41.959676 24978 log.cc:824] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:41.962487 24978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2: No bootstrap required, opened a new log
I20260808 08:38:41.969933 24978 raft_consensus.cc:348] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f83bd6621752437e9b5730be7a5aa6e2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42809 } }
I20260808 08:38:41.970320 24978 raft_consensus.cc:374] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:41.970463 24978 raft_consensus.cc:729] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f83bd6621752437e9b5730be7a5aa6e2, State: Initialized, Role: FOLLOWER
I20260808 08:38:41.971104 24978 consensus_queue.cc:260] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f83bd6621752437e9b5730be7a5aa6e2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42809 } }
I20260808 08:38:41.971422 24978 raft_consensus.cc:388] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:38:41.971590 24978 raft_consensus.cc:482] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:38:41.971787 24978 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:41.974040 24978 raft_consensus.cc:504] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f83bd6621752437e9b5730be7a5aa6e2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42809 } }
I20260808 08:38:41.974593 24978 leader_election.cc:302] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f83bd6621752437e9b5730be7a5aa6e2; no voters:
I20260808 08:38:41.975411 24978 leader_election.cc:288] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:38:41.975533 24983 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:38:41.976316 24983 raft_consensus.cc:686] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [term 1 LEADER]: Becoming Leader. State: Replica: f83bd6621752437e9b5730be7a5aa6e2, State: Running, Role: LEADER
I20260808 08:38:41.976900 24983 consensus_queue.cc:237] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f83bd6621752437e9b5730be7a5aa6e2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42809 } }
I20260808 08:38:41.978025 24978 sys_catalog.cc:564] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:38:41.980047 24985 sys_catalog.cc:455] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f83bd6621752437e9b5730be7a5aa6e2. Latest consensus state: current_term: 1 leader_uuid: "f83bd6621752437e9b5730be7a5aa6e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f83bd6621752437e9b5730be7a5aa6e2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42809 } } }
I20260808 08:38:41.980430 24985 sys_catalog.cc:458] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [sys.catalog]: This master's current role is: LEADER
I20260808 08:38:41.981233 24984 sys_catalog.cc:455] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f83bd6621752437e9b5730be7a5aa6e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f83bd6621752437e9b5730be7a5aa6e2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 42809 } } }
I20260808 08:38:41.981494 24989 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:38:41.981570 24984 sys_catalog.cc:458] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2 [sys.catalog]: This master's current role is: LEADER
I20260808 08:38:41.988229 24989 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:38:41.998670 24989 catalog_manager.cc:1347] Generated new cluster ID: 7baee88e55224b9aa8879c265597bf43
I20260808 08:38:41.998811 24989 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:38:42.009305 24989 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:38:42.011179 24989 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:38:42.020229 24989 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2: Generated new TSK 0
I20260808 08:38:42.021315 24989 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:38:42.032691 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:42809
--builtin_ntp_servers=127.5.164.212:34501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:38:42.383955 25002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:42.384429 25002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:42.384554 25002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:42.392124 25002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:42.392227 25002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:42.392333 25002 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:38:42.401737 25002 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:42809
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:42.403007 25002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:42.404886 25002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:42.418866 25008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:42.418891 25007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:42.418866 25010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:42.419979 25002 server_base.cc:1034] running on GCE node
I20260808 08:38:42.420707 25002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:42.421746 25002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:42.422988 25002 hybrid_clock.cc:648] HybridClock initialized: now 1786178322422938 us; error 49 us; skew 500 ppm
I20260808 08:38:42.423388 25002 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:38:42.425844 25002 webserver.cc:460] Webserver started at http://127.5.164.193:44931/ using document root <none> and password file <none>
I20260808 08:38:42.426582 25002 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:42.426724 25002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:42.427070 25002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:42.430152 25002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "5c98bcf7b9204560a6ea80e2e3fa296b"
format_stamp: "Formatted at 2026-08-08 08:38:42 on dist-test-slave-chsk"
server_key: "f70863b9f18ce8b5033c0c2aff645389"
server_key_iv: "75152ed22b4aa63e8c17de9217ea893c"
server_key_version: "encryptionkey@0"
I20260808 08:38:42.430984 25002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "5c98bcf7b9204560a6ea80e2e3fa296b"
format_stamp: "Formatted at 2026-08-08 08:38:42 on dist-test-slave-chsk"
server_key: "f70863b9f18ce8b5033c0c2aff645389"
server_key_iv: "75152ed22b4aa63e8c17de9217ea893c"
server_key_version: "encryptionkey@0"
I20260808 08:38:42.436328 25002 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 08:38:42.440021 25016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:42.441435 25002 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:38:42.441619 25002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "5c98bcf7b9204560a6ea80e2e3fa296b"
format_stamp: "Formatted at 2026-08-08 08:38:42 on dist-test-slave-chsk"
server_key: "f70863b9f18ce8b5033c0c2aff645389"
server_key_iv: "75152ed22b4aa63e8c17de9217ea893c"
server_key_version: "encryptionkey@0"
I20260808 08:38:42.441874 25002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:42.475462 25002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:42.476333 25002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:42.476650 25002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:42.477656 25002 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:42.479437 25002 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:42.479559 25002 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:42.479691 25002 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:42.479789 25002 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:42.514246 25002 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:37437
I20260808 08:38:42.514339 25134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:37437 every 8 connection(s)
I20260808 08:38:42.515635 25002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:38:42.516623 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 25002
I20260808 08:38:42.516832 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:38:42.517318 5779 external_mini_cluster.cc:1428] Setting key dd224993dba6c29f29162600d54e79a3
I20260808 08:38:42.520844 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:42809
--builtin_ntp_servers=127.5.164.212:34501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:38:42.529482 25137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:42.518413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:38819 (local address 127.5.164.254:42809)
0808 08:38:42.519029 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:42.519034 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:42.520383 (+ 1349us) server_negotiation.cc:407] Connection header received
0808 08:38:42.522216 (+ 1833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:42.522225 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:42.522330 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:42.522458 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:42.523659 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:42.524793 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:42.526314 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:42.526997 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:42.527157 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:42.528468 (+ 1311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:42.528477 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:42.528484 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:42.528511 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:42.528561 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:42.528579 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:42.528674 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:42.528873 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 08:38:42.528999 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":418,"threads_started":1}
I20260808 08:38:42.530136 25138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:42.519031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:42809 (local address 127.5.164.193:38819)
0808 08:38:42.520127 (+ 1096us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:42.520212 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:42.521933 (+ 1721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:42.522642 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:42.522650 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:42.522727 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:42.523495 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:42.523512 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:42.524940 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:42.524943 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:42.526164 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:42.526180 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:42.527277 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:42.527283 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:42.527466 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:42.528168 (+ 702us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:38:42.528170 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:42.528205 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:38:42.528273 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:42.528676 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:42.528683 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:42.528688 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:38:42.528810 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 08:38:42.529106 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":649,"thread_start_us":405,"threads_started":1}
I20260808 08:38:42.531644 25135 heartbeater.cc:347] Connected to a master server at 127.5.164.254:42809
I20260808 08:38:42.531965 25135 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:42.532857 25135 heartbeater.cc:511] Master 127.5.164.254:42809 requested a full tablet report, sending...
I20260808 08:38:42.535082 24941 ts_manager.cc:194] Registered new tserver with Master: 5c98bcf7b9204560a6ea80e2e3fa296b (127.5.164.193:37437)
I20260808 08:38:42.536604 24941 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.164.193:38819
W20260808 08:38:42.868920 25140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:42.869230 25140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:42.869379 25140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:42.876832 25140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:42.876940 25140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:42.877102 25140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:38:42.886801 25140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:42809
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:42.888180 25140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:42.890118 25140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:42.904759 25146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:42.904855 25148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:42.904889 25145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:42.905812 25140 server_base.cc:1034] running on GCE node
I20260808 08:38:42.906526 25140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:42.907567 25140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:42.908787 25140 hybrid_clock.cc:648] HybridClock initialized: now 1786178322908721 us; error 59 us; skew 500 ppm
I20260808 08:38:42.909149 25140 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:38:42.911614 25140 webserver.cc:460] Webserver started at http://127.5.164.194:42745/ using document root <none> and password file <none>
I20260808 08:38:42.912343 25140 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:42.912469 25140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:42.912811 25140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:42.915910 25140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "83dc29d2492c40e0a7ef9e275202b96d"
format_stamp: "Formatted at 2026-08-08 08:38:42 on dist-test-slave-chsk"
server_key: "6d4e834411abb2250821e64a061fa0b0"
server_key_iv: "a129a45cf44b5e937ce909ff6c8c2f22"
server_key_version: "encryptionkey@0"
I20260808 08:38:42.916712 25140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "83dc29d2492c40e0a7ef9e275202b96d"
format_stamp: "Formatted at 2026-08-08 08:38:42 on dist-test-slave-chsk"
server_key: "6d4e834411abb2250821e64a061fa0b0"
server_key_iv: "a129a45cf44b5e937ce909ff6c8c2f22"
server_key_version: "encryptionkey@0"
I20260808 08:38:42.922107 25140 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:38:42.926184 25154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:42.927629 25140 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:38:42.927822 25140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "83dc29d2492c40e0a7ef9e275202b96d"
format_stamp: "Formatted at 2026-08-08 08:38:42 on dist-test-slave-chsk"
server_key: "6d4e834411abb2250821e64a061fa0b0"
server_key_iv: "a129a45cf44b5e937ce909ff6c8c2f22"
server_key_version: "encryptionkey@0"
I20260808 08:38:42.928066 25140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:42.961287 25140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:42.962198 25140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:42.962523 25140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:42.963619 25140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:42.965313 25140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:42.965442 25140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:42.965582 25140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:42.965672 25140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:43.000734 25140 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:41869
I20260808 08:38:43.000826 25271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:41869 every 8 connection(s)
I20260808 08:38:43.002151 25140 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:38:43.005733 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 25140
I20260808 08:38:43.005939 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:38:43.006389 5779 external_mini_cluster.cc:1428] Setting key 4764a96e3b81980f220bcc602c358a9a
I20260808 08:38:43.009719 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:42809
--builtin_ntp_servers=127.5.164.212:34501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:38:43.016729 25137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.005006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:53425 (local address 127.5.164.254:42809)
0808 08:38:43.005208 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:43.005213 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:43.006781 (+ 1568us) server_negotiation.cc:407] Connection header received
0808 08:38:43.009165 (+ 2384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:43.009179 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:43.009263 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:43.009379 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:43.010544 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.011784 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.013504 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.014183 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.014335 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.015783 (+ 1448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:43.015792 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:43.015799 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:43.015825 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:43.015871 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:43.015890 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:43.015988 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:43.016212 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 08:38:43.016330 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:38:43.017781 25274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.005469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:42809 (local address 127.5.164.194:53425)
0808 08:38:43.006580 (+ 1111us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:43.006627 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:43.008888 (+ 2261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:43.009583 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:43.009591 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:43.009677 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:43.010364 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:43.010382 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.011965 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.011970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:43.013340 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:43.013359 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.014435 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.014441 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:43.014652 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.015442 (+ 790us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:38:43.015444 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:43.015484 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:38:43.015567 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:43.015993 (+ 426us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:43.016001 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:43.016007 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 08:38:43.016159 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 08:38:43.016463 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":373,"threads_started":1}
I20260808 08:38:43.019445 25272 heartbeater.cc:347] Connected to a master server at 127.5.164.254:42809
I20260808 08:38:43.019747 25272 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:43.020670 25272 heartbeater.cc:511] Master 127.5.164.254:42809 requested a full tablet report, sending...
I20260808 08:38:43.022334 24941 ts_manager.cc:194] Registered new tserver with Master: 83dc29d2492c40e0a7ef9e275202b96d (127.5.164.194:41869)
I20260808 08:38:43.023582 24941 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.164.194:53425
W20260808 08:38:43.367529 25275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:43.367884 25275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:43.368062 25275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:43.375569 25275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:43.375726 25275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:43.375907 25275 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:38:43.385901 25275 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:42809
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:43.387351 25275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:43.389259 25275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:43.403034 25284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:43.403070 25280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:43.403119 25282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:43.408758 25275 server_base.cc:1034] running on GCE node
I20260808 08:38:43.409507 25275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:43.410605 25275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:43.411857 25275 hybrid_clock.cc:648] HybridClock initialized: now 1786178323411810 us; error 45 us; skew 500 ppm
I20260808 08:38:43.412245 25275 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:38:43.414906 25275 webserver.cc:460] Webserver started at http://127.5.164.195:39011/ using document root <none> and password file <none>
I20260808 08:38:43.415758 25275 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:43.415903 25275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:43.416268 25275 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:43.419358 25275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "42680ceea7ed4a8eb575ef1ed331c6e1"
format_stamp: "Formatted at 2026-08-08 08:38:43 on dist-test-slave-chsk"
server_key: "ca5896e2dee03edca768bd38d878c875"
server_key_iv: "35e52cb66895ff7796b32db45dd4e72f"
server_key_version: "encryptionkey@0"
I20260808 08:38:43.420207 25275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "42680ceea7ed4a8eb575ef1ed331c6e1"
format_stamp: "Formatted at 2026-08-08 08:38:43 on dist-test-slave-chsk"
server_key: "ca5896e2dee03edca768bd38d878c875"
server_key_iv: "35e52cb66895ff7796b32db45dd4e72f"
server_key_version: "encryptionkey@0"
I20260808 08:38:43.426143 25275 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260808 08:38:43.430114 25291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:43.431738 25275 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:38:43.431959 25275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "42680ceea7ed4a8eb575ef1ed331c6e1"
format_stamp: "Formatted at 2026-08-08 08:38:43 on dist-test-slave-chsk"
server_key: "ca5896e2dee03edca768bd38d878c875"
server_key_iv: "35e52cb66895ff7796b32db45dd4e72f"
server_key_version: "encryptionkey@0"
I20260808 08:38:43.432220 25275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:43.452411 25275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:43.453392 25275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:43.453747 25275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:43.454820 25275 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:43.456525 25275 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:43.456660 25275 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:43.456800 25275 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:43.456890 25275 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:43.492734 25275 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:43141
I20260808 08:38:43.492830 25411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:43141 every 8 connection(s)
I20260808 08:38:43.494169 25275 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:38:43.496469 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 25275
I20260808 08:38:43.496665 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:38:43.497289 5779 external_mini_cluster.cc:1428] Setting key e072bcc8f4ca14f68d429712f252e25f
I20260808 08:38:43.507696 25137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.497172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:47571 (local address 127.5.164.254:42809)
0808 08:38:43.497421 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:43.497428 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:43.499164 (+ 1736us) server_negotiation.cc:407] Connection header received
0808 08:38:43.501208 (+ 2044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:43.501212 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:43.501287 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:43.501368 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:43.502477 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.503294 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.504948 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.505338 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.505432 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.506857 (+ 1425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:43.506863 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:43.506866 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:43.506889 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:43.506925 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:43.506937 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:43.507023 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:43.507297 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 08:38:43.507403 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 08:38:43.508749 25414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.497796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:42809 (local address 127.5.164.195:47571)
0808 08:38:43.498953 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:43.499004 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:43.500937 (+ 1933us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:43.501584 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:43.501593 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:43.501686 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:43.502320 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:43.502339 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.503423 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.503427 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:43.504818 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:43.504831 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.505533 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.505538 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:43.505752 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.506483 (+ 731us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:38:43.506485 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:43.506528 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:38:43.506622 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:43.507035 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:43.507043 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:43.507049 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 08:38:43.507270 (+ 221us) client_negotiation.cc:240] Negotiation successful
0808 08:38:43.507607 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":346,"threads_started":1}
I20260808 08:38:43.510648 25412 heartbeater.cc:347] Connected to a master server at 127.5.164.254:42809
I20260808 08:38:43.511056 25412 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:43.512132 25412 heartbeater.cc:511] Master 127.5.164.254:42809 requested a full tablet report, sending...
I20260808 08:38:43.514084 24941 ts_manager.cc:194] Registered new tserver with Master: 42680ceea7ed4a8eb575ef1ed331c6e1 (127.5.164.195:43141)
I20260808 08:38:43.514971 24941 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.164.195:47571
I20260808 08:38:43.526301 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:38:43.537369 25137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.530746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56078 (local address 127.5.164.254:42809)
0808 08:38:43.531016 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:43.531025 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:43.531468 (+ 443us) server_negotiation.cc:407] Connection header received
0808 08:38:43.531698 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:43.531702 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:43.531775 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:43.531946 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:43.532450 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.533214 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.534717 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.535235 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.535384 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.536586 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:43.536591 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:43.536594 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:43.536622 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:43.536657 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:43.536668 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:43.536768 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:43.536945 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 08:38:43.537054 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 08:38:43.539544 25135 heartbeater.cc:503] Master 127.5.164.254:42809 was elected leader, sending a full tablet report...
I20260808 08:38:43.541723 24941 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56078:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:38:43.548991 24941 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:38:43.579165 25427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.561684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37437 (local address 127.0.0.1:57810)
0808 08:38:43.563707 (+ 2023us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:43.563746 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:43.563931 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:43.567528 (+ 3597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:43.567536 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:43.567573 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:43.568141 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:43.568157 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.572712 (+ 4555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.572721 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:43.575982 (+ 3261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:43.576008 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.577865 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.577873 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:43.578189 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.578313 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 08:38:43.578451 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 08:38:43.578715 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1759,"mutex_wait_us":31,"thread_start_us":1607,"threads_started":1}
I20260808 08:38:43.579329 25428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.562016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57810 (local address 127.5.164.193:37437)
0808 08:38:43.566757 (+ 4741us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:43.566770 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:43.566808 (+ 38us) server_negotiation.cc:407] Connection header received
0808 08:38:43.566912 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:43.566920 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:43.567250 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:43.568385 (+ 1135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:43.568691 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.572485 (+ 3794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.576309 (+ 3824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.577594 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.578362 (+ 768us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.578704 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:43.578777 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 08:38:43.578937 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4514,"thread_start_us":2905,"threads_started":1}
I20260808 08:38:43.579913 25430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.562915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49390 (local address 127.5.164.195:43141)
0808 08:38:43.565703 (+ 2788us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:43.565717 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:43.565765 (+ 48us) server_negotiation.cc:407] Connection header received
0808 08:38:43.565880 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:43.565890 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:43.566210 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:43.566484 (+ 274us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:43.567849 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.570090 (+ 2241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.575988 (+ 5898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.577614 (+ 1626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.577760 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.578085 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:43.578629 (+ 544us) server_negotiation.cc:299] Negotiation successful
0808 08:38:43.578832 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2597,"thread_start_us":2998,"threads_started":1}
I20260808 08:38:43.580886 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.562074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:43141 (local address 127.0.0.1:49390)
0808 08:38:43.564557 (+ 2483us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:43.564576 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:43.564694 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:43.566893 (+ 2199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:43.566905 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:43.566961 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:43.567521 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:43.567538 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.570334 (+ 2796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.570344 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:43.575608 (+ 5264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:43.575632 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.578065 (+ 2433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.578073 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:43.578361 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.578401 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 08:38:43.578484 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 08:38:43.580437 (+ 1953us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2339,"mutex_wait_us":1838,"thread_start_us":2178,"threads_started":1}
I20260808 08:38:43.584124 25069 tablet_service.cc:1467] Processing CreateTablet for tablet 988e93c690854793ac0529468b8f3424 (DEFAULT_TABLE table=test-table [id=ac9f342197ab42b4bc9d915129972ad2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:43.584403 25343 tablet_service.cc:1467] Processing CreateTablet for tablet 988e93c690854793ac0529468b8f3424 (DEFAULT_TABLE table=test-table [id=ac9f342197ab42b4bc9d915129972ad2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:43.585135 25431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.565008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:41869 (local address 127.0.0.1:56780)
0808 08:38:43.576598 (+ 11590us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:43.576620 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:43.576767 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:43.577718 (+ 951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:43.577768 (+ 50us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:43.577802 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:43.578308 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:43.578353 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.580545 (+ 2192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.580550 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:43.582281 (+ 1731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:43.582298 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.584228 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.584235 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:43.584429 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.584467 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 08:38:43.584574 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 08:38:43.584762 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11446,"thread_start_us":11271,"threads_started":1}
I20260808 08:38:43.585150 25432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.565759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56780 (local address 127.5.164.194:41869)
0808 08:38:43.576969 (+ 11210us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:43.576990 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:43.577026 (+ 36us) server_negotiation.cc:407] Connection header received
0808 08:38:43.577138 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:43.577148 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:43.577448 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:43.577712 (+ 264us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:43.578556 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.580420 (+ 1864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.582514 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.583990 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.584179 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.584445 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:43.584617 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 08:38:43.584789 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11010,"thread_start_us":11081,"threads_started":1}
I20260808 08:38:43.586100 25343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 988e93c690854793ac0529468b8f3424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:43.586154 25069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 988e93c690854793ac0529468b8f3424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:43.588824 25202 tablet_service.cc:1467] Processing CreateTablet for tablet 988e93c690854793ac0529468b8f3424 (DEFAULT_TABLE table=test-table [id=ac9f342197ab42b4bc9d915129972ad2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:43.590282 25202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 988e93c690854793ac0529468b8f3424. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:43.598788 25433 tablet_bootstrap.cc:492] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1: Bootstrap starting.
I20260808 08:38:43.602270 25433 tablet_bootstrap.cc:654] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:43.603804 25433 log.cc:824] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:43.606630 25436 tablet_bootstrap.cc:492] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b: Bootstrap starting.
I20260808 08:38:43.607213 25433 tablet_bootstrap.cc:492] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1: No bootstrap required, opened a new log
I20260808 08:38:43.607527 25433 ts_tablet_manager.cc:1397] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 08:38:43.610883 25436 tablet_bootstrap.cc:654] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:43.612257 25435 tablet_bootstrap.cc:492] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d: Bootstrap starting.
I20260808 08:38:43.612323 25436 log.cc:824] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:43.616478 25435 tablet_bootstrap.cc:654] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:43.616858 25436 tablet_bootstrap.cc:492] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b: No bootstrap required, opened a new log
I20260808 08:38:43.617157 25436 ts_tablet_manager.cc:1397] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260808 08:38:43.617707 25435 log.cc:824] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:43.618500 25433 raft_consensus.cc:348] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c98bcf7b9204560a6ea80e2e3fa296b" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37437 } } peers { permanent_uuid: "42680ceea7ed4a8eb575ef1ed331c6e1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43141 } } peers { permanent_uuid: "83dc29d2492c40e0a7ef9e275202b96d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41869 } }
I20260808 08:38:43.618989 25433 raft_consensus.cc:374] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:43.619108 25433 raft_consensus.cc:729] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42680ceea7ed4a8eb575ef1ed331c6e1, State: Initialized, Role: FOLLOWER
I20260808 08:38:43.619796 25433 consensus_queue.cc:260] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c98bcf7b9204560a6ea80e2e3fa296b" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37437 } } peers { permanent_uuid: "42680ceea7ed4a8eb575ef1ed331c6e1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43141 } } peers { permanent_uuid: "83dc29d2492c40e0a7ef9e275202b96d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41869 } }
I20260808 08:38:43.621066 25435 tablet_bootstrap.cc:492] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d: No bootstrap required, opened a new log
I20260808 08:38:43.621044 25412 heartbeater.cc:503] Master 127.5.164.254:42809 was elected leader, sending a full tablet report...
I20260808 08:38:43.621369 25435 ts_tablet_manager.cc:1397] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 08:38:43.621733 25433 ts_tablet_manager.cc:1428] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260808 08:38:43.627941 25436 raft_consensus.cc:348] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c98bcf7b9204560a6ea80e2e3fa296b" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37437 } } peers { permanent_uuid: "42680ceea7ed4a8eb575ef1ed331c6e1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43141 } } peers { permanent_uuid: "83dc29d2492c40e0a7ef9e275202b96d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41869 } }
I20260808 08:38:43.628610 25436 raft_consensus.cc:374] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:43.628731 25436 raft_consensus.cc:729] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c98bcf7b9204560a6ea80e2e3fa296b, State: Initialized, Role: FOLLOWER
I20260808 08:38:43.629436 25436 consensus_queue.cc:260] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c98bcf7b9204560a6ea80e2e3fa296b" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37437 } } peers { permanent_uuid: "42680ceea7ed4a8eb575ef1ed331c6e1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43141 } } peers { permanent_uuid: "83dc29d2492c40e0a7ef9e275202b96d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41869 } }
I20260808 08:38:43.630764 25435 raft_consensus.cc:348] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c98bcf7b9204560a6ea80e2e3fa296b" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37437 } } peers { permanent_uuid: "42680ceea7ed4a8eb575ef1ed331c6e1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43141 } } peers { permanent_uuid: "83dc29d2492c40e0a7ef9e275202b96d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41869 } }
I20260808 08:38:43.631222 25435 raft_consensus.cc:374] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:43.631294 25436 ts_tablet_manager.cc:1428] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b: Time spent starting tablet: real 0.014s user 0.011s sys 0.005s
I20260808 08:38:43.631356 25435 raft_consensus.cc:729] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83dc29d2492c40e0a7ef9e275202b96d, State: Initialized, Role: FOLLOWER
I20260808 08:38:43.632050 25435 consensus_queue.cc:260] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c98bcf7b9204560a6ea80e2e3fa296b" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37437 } } peers { permanent_uuid: "42680ceea7ed4a8eb575ef1ed331c6e1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43141 } } peers { permanent_uuid: "83dc29d2492c40e0a7ef9e275202b96d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41869 } }
I20260808 08:38:43.633343 25272 heartbeater.cc:503] Master 127.5.164.254:42809 was elected leader, sending a full tablet report...
I20260808 08:38:43.634101 25435 ts_tablet_manager.cc:1428] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d: Time spent starting tablet: real 0.013s user 0.006s sys 0.008s
W20260808 08:38:43.746053 25413 tablet.cc:2369] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:38:43.754606 25273 tablet.cc:2369] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:38:43.768326 25136 tablet.cc:2369] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:38:43.811522 25440 raft_consensus.cc:482] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:38:43.811923 25440 raft_consensus.cc:504] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c98bcf7b9204560a6ea80e2e3fa296b" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37437 } } peers { permanent_uuid: "42680ceea7ed4a8eb575ef1ed331c6e1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43141 } } peers { permanent_uuid: "83dc29d2492c40e0a7ef9e275202b96d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41869 } }
I20260808 08:38:43.813778 25440 leader_election.cc:288] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42680ceea7ed4a8eb575ef1ed331c6e1 (127.5.164.195:43141), 83dc29d2492c40e0a7ef9e275202b96d (127.5.164.194:41869)
I20260808 08:38:43.820693 25432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.814307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:50361 (local address 127.5.164.194:41869)
0808 08:38:43.814518 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:43.814525 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:43.815270 (+ 745us) server_negotiation.cc:407] Connection header received
0808 08:38:43.815538 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:43.815543 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:43.815623 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:43.815749 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:43.816306 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.817030 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.818899 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.819720 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.819906 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.819982 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:43.820268 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 08:38:43.820402 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:38:43.820716 25444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.814112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:41869 (local address 127.5.164.193:50361)
0808 08:38:43.815088 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:43.815113 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:43.815353 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:43.815774 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:43.815779 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:43.815806 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:43.816122 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:43.816152 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.817177 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.817183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:43.818696 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:43.818709 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.819910 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.819916 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:43.820097 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.820125 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 08:38:43.820240 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 08:38:43.820377 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":825,"thread_start_us":1068,"threads_started":1}
I20260808 08:38:43.820883 25442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.814264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:43141 (local address 127.5.164.193:50201)
0808 08:38:43.815554 (+ 1290us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:43.815567 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:43.815706 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:43.816055 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:43.816060 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:43.816091 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:43.816464 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:43.816473 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.817490 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.817495 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:43.818907 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:43.818919 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.820127 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.820134 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:43.820294 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.820318 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:38:43.820424 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 08:38:43.820550 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1172,"thread_start_us":451,"threads_started":1}
I20260808 08:38:43.821297 25430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.814307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:50201 (local address 127.5.164.195:43141)
0808 08:38:43.814530 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:43.814536 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:43.815665 (+ 1129us) server_negotiation.cc:407] Connection header received
0808 08:38:43.815856 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:43.815861 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:43.815924 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:43.816026 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:43.816633 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.817346 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.819095 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.819924 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.820111 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.820182 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:43.820454 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 08:38:43.820593 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:38:43.821810 25222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "988e93c690854793ac0529468b8f3424" candidate_uuid: "5c98bcf7b9204560a6ea80e2e3fa296b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83dc29d2492c40e0a7ef9e275202b96d" is_pre_election: true
I20260808 08:38:43.822213 25365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "988e93c690854793ac0529468b8f3424" candidate_uuid: "5c98bcf7b9204560a6ea80e2e3fa296b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42680ceea7ed4a8eb575ef1ed331c6e1" is_pre_election: true
I20260808 08:38:43.822395 25222 raft_consensus.cc:2454] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c98bcf7b9204560a6ea80e2e3fa296b in term 0.
I20260808 08:38:43.822710 25365 raft_consensus.cc:2454] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c98bcf7b9204560a6ea80e2e3fa296b in term 0.
I20260808 08:38:43.823266 25019 leader_election.cc:302] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c98bcf7b9204560a6ea80e2e3fa296b, 83dc29d2492c40e0a7ef9e275202b96d; no voters:
I20260808 08:38:43.823756 25440 raft_consensus.cc:2781] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:38:43.823926 25440 raft_consensus.cc:482] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:38:43.824040 25440 raft_consensus.cc:3037] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:43.826259 25440 raft_consensus.cc:504] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c98bcf7b9204560a6ea80e2e3fa296b" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37437 } } peers { permanent_uuid: "42680ceea7ed4a8eb575ef1ed331c6e1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43141 } } peers { permanent_uuid: "83dc29d2492c40e0a7ef9e275202b96d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41869 } }
I20260808 08:38:43.826916 25440 leader_election.cc:288] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [CANDIDATE]: Term 1 election: Requested vote from peers 42680ceea7ed4a8eb575ef1ed331c6e1 (127.5.164.195:43141), 83dc29d2492c40e0a7ef9e275202b96d (127.5.164.194:41869)
I20260808 08:38:43.827601 25222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "988e93c690854793ac0529468b8f3424" candidate_uuid: "5c98bcf7b9204560a6ea80e2e3fa296b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83dc29d2492c40e0a7ef9e275202b96d"
I20260808 08:38:43.827643 25365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "988e93c690854793ac0529468b8f3424" candidate_uuid: "5c98bcf7b9204560a6ea80e2e3fa296b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42680ceea7ed4a8eb575ef1ed331c6e1"
I20260808 08:38:43.827831 25222 raft_consensus.cc:3037] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:43.827872 25365 raft_consensus.cc:3037] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:43.830305 25222 raft_consensus.cc:2454] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c98bcf7b9204560a6ea80e2e3fa296b in term 1.
I20260808 08:38:43.830473 25365 raft_consensus.cc:2454] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c98bcf7b9204560a6ea80e2e3fa296b in term 1.
I20260808 08:38:43.830832 25019 leader_election.cc:302] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c98bcf7b9204560a6ea80e2e3fa296b, 83dc29d2492c40e0a7ef9e275202b96d; no voters:
I20260808 08:38:43.831290 25440 raft_consensus.cc:2781] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:38:43.831776 25440 raft_consensus.cc:686] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [term 1 LEADER]: Becoming Leader. State: Replica: 5c98bcf7b9204560a6ea80e2e3fa296b, State: Running, Role: LEADER
I20260808 08:38:43.832341 25440 consensus_queue.cc:237] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c98bcf7b9204560a6ea80e2e3fa296b" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37437 } } peers { permanent_uuid: "42680ceea7ed4a8eb575ef1ed331c6e1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43141 } } peers { permanent_uuid: "83dc29d2492c40e0a7ef9e275202b96d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41869 } }
I20260808 08:38:43.837651 24940 catalog_manager.cc:5495] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c98bcf7b9204560a6ea80e2e3fa296b (127.5.164.193). New cstate: current_term: 1 leader_uuid: "5c98bcf7b9204560a6ea80e2e3fa296b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c98bcf7b9204560a6ea80e2e3fa296b" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42680ceea7ed4a8eb575ef1ed331c6e1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83dc29d2492c40e0a7ef9e275202b96d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41869 } health_report { overall_health: UNKNOWN } } }
I20260808 08:38:43.872154 25428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.866316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57816 (local address 127.5.164.193:37437)
0808 08:38:43.866533 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:43.866539 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:43.866652 (+ 113us) server_negotiation.cc:407] Connection header received
0808 08:38:43.866920 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:43.866925 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:43.867020 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:43.867211 (+ 191us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:38:43.867609 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.868343 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.869781 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.870221 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.870369 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.870941 (+ 572us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:38:43.871541 (+ 600us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:38:43.871707 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:43.871798 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 08:38:43.871884 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:38:43.880743 25365 raft_consensus.cc:1261] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1 [term 1 FOLLOWER]: Refusing update from remote peer 5c98bcf7b9204560a6ea80e2e3fa296b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:38:43.880743 25222 raft_consensus.cc:1261] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d [term 1 FOLLOWER]: Refusing update from remote peer 5c98bcf7b9204560a6ea80e2e3fa296b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:38:43.881808 25445 consensus_queue.cc:1035] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [LEADER]: Connected to new peer: Peer: permanent_uuid: "42680ceea7ed4a8eb575ef1ed331c6e1" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:38:43.882211 25440 consensus_queue.cc:1035] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [LEADER]: Connected to new peer: Peer: permanent_uuid: "83dc29d2492c40e0a7ef9e275202b96d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 41869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:38:43.892450 25448 mvcc.cc:205] Tried to move back new op lower bound from 7316186414604783616 to 7316186414421786624. Current Snapshot: MvccSnapshot[applied={T|T < 7316186414604783616}]
I20260808 08:38:43.895715 25450 mvcc.cc:205] Tried to move back new op lower bound from 7316186414604783616 to 7316186414421786624. Current Snapshot: MvccSnapshot[applied={T|T < 7316186414604783616}]
I20260808 08:38:43.910940 24941 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:38:43.911293 24941 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56078:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:38:43.915508 24941 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f83bd6621752437e9b5730be7a5aa6e2: Sending DeleteTablet for 3 replicas of tablet 988e93c690854793ac0529468b8f3424
I20260808 08:38:43.916877 25343 tablet_service.cc:1514] Processing DeleteTablet for tablet 988e93c690854793ac0529468b8f3424 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:43 UTC) from {username='slave'} at 127.0.0.1:49390
I20260808 08:38:43.916883 25069 tablet_service.cc:1514] Processing DeleteTablet for tablet 988e93c690854793ac0529468b8f3424 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:43 UTC) from {username='slave'} at 127.0.0.1:57810
I20260808 08:38:43.918226 25460 tablet_replica.cc:330] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1: stopping tablet replica
I20260808 08:38:43.918341 25202 tablet_service.cc:1514] Processing DeleteTablet for tablet 988e93c690854793ac0529468b8f3424 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:43 UTC) from {username='slave'} at 127.0.0.1:56780
I20260808 08:38:43.918901 25460 raft_consensus.cc:2229] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:38:43.919111 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 25002
I20260808 08:38:43.919588 25460 raft_consensus.cc:2258] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:38:43.922202 25460 ts_tablet_manager.cc:1905] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:38:43.924772 25459 tablet_replica.cc:330] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b: stopping tablet replica
I20260808 08:38:43.925427 25459 raft_consensus.cc:2229] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:38:43.926319 25459 raft_consensus.cc:2258] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:38:43.927038 25461 tablet_replica.cc:330] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d: stopping tablet replica
I20260808 08:38:43.927589 25461 raft_consensus.cc:2229] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:38:43.928146 25461 raft_consensus.cc:2258] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:38:43.928930 25459 ts_tablet_manager.cc:1905] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:38:43.933743 25460 ts_tablet_manager.cc:1918] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:43.933941 25460 log.cc:1196] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/988e93c690854793ac0529468b8f3424
I20260808 08:38:43.934091 25461 ts_tablet_manager.cc:1905] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:38:43.934526 25460 ts_tablet_manager.cc:1939] T 988e93c690854793ac0529468b8f3424 P 42680ceea7ed4a8eb575ef1ed331c6e1: Deleting consensus metadata
I20260808 08:38:43.937431 25428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:43.922507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57820 (local address 127.5.164.193:37437)
0808 08:38:43.922725 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:43.922734 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:43.922822 (+ 88us) server_negotiation.cc:407] Connection header received
0808 08:38:43.923065 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:43.923072 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:43.923306 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:43.923444 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:43.927338 (+ 3894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.928618 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.930655 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:43.931421 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:43.931531 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:43.935554 (+ 4023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:43.935569 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:43.935597 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:43.936432 (+ 835us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:43.936495 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:43.936523 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:43.936612 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:43.936918 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 08:38:43.937054 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:38:43.938690 25130 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:43.939577 24928 catalog_manager.cc:4841] TS 42680ceea7ed4a8eb575ef1ed331c6e1 (127.5.164.195:43141): tablet 988e93c690854793ac0529468b8f3424 (table test-table [id=ac9f342197ab42b4bc9d915129972ad2]) successfully deleted
I20260808 08:38:43.948637 25461 ts_tablet_manager.cc:1918] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:43.948841 25461 log.cc:1196] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/988e93c690854793ac0529468b8f3424
I20260808 08:38:43.949396 25461 ts_tablet_manager.cc:1939] T 988e93c690854793ac0529468b8f3424 P 83dc29d2492c40e0a7ef9e275202b96d: Deleting consensus metadata
I20260808 08:38:43.951552 24927 catalog_manager.cc:4841] TS 83dc29d2492c40e0a7ef9e275202b96d (127.5.164.194:41869): tablet 988e93c690854793ac0529468b8f3424 (table test-table [id=ac9f342197ab42b4bc9d915129972ad2]) successfully deleted
I20260808 08:38:44.062319 25459 ts_tablet_manager.cc:1918] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:44.062664 25459 log.cc:1196] T 988e93c690854793ac0529468b8f3424 P 5c98bcf7b9204560a6ea80e2e3fa296b: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/988e93c690854793ac0529468b8f3424
I20260808 08:38:44.063284 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 25002
I20260808 08:38:44.088279 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 25140
W20260808 08:38:44.088248 24923 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.164.193:37437 (error 108)
I20260808 08:38:44.090710 25465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:44.089825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37437 (local address 127.0.0.1:57836)
0808 08:38:44.090287 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:44.090468 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":218,"threads_started":1}
W20260808 08:38:44.091066 24923 catalog_manager.cc:4584] TS 5c98bcf7b9204560a6ea80e2e3fa296b (127.5.164.193:37437): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 988e93c690854793ac0529468b8f3424: Network error: Client connection negotiation failed: client connection to 127.5.164.193:37437: connect: Connection refused (error 111)
I20260808 08:38:44.097244 25432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:44.089210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56788 (local address 127.5.164.194:41869)
0808 08:38:44.089416 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:44.089421 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:44.089458 (+ 37us) server_negotiation.cc:407] Connection header received
0808 08:38:44.089640 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:44.089644 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:44.089736 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:44.089828 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:44.090444 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:44.091599 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:44.093087 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:44.093559 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:44.093685 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:44.094954 (+ 1269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:44.094965 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:44.094980 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:44.096141 (+ 1161us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:44.096232 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:44.096275 (+ 43us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:44.096502 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:44.096735 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 08:38:44.096892 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:38:44.098029 25267 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:44.144861 25465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:44.144359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37437 (local address 127.0.0.1:57848)
0808 08:38:44.144600 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:44.144703 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260808 08:38:44.146049 25465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:44.145631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37437 (local address 127.0.0.1:57858)
0808 08:38:44.145822 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:44.145897 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 08:38:44.192476 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 25140
I20260808 08:38:44.207309 25465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:44.206717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37437 (local address 127.0.0.1:57874)
0808 08:38:44.206956 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:44.207056 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260808 08:38:44.208460 25465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:44.208047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37437 (local address 127.0.0.1:57884)
0808 08:38:44.208224 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:44.208311 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 08:38:44.213627 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 25275
I20260808 08:38:44.223738 25430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:44.214538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49406 (local address 127.5.164.195:43141)
0808 08:38:44.214735 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:44.214740 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:44.214760 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:38:44.214865 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:44.214870 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:44.214974 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:44.215062 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:44.215534 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:44.216309 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:44.217780 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:44.218209 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:44.218326 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:44.222279 (+ 3953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:44.222290 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:44.222306 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:44.222968 (+ 662us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:44.223027 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:44.223049 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:44.223223 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:44.223338 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 08:38:44.223449 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:38:44.224449 25407 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:44.288949 25465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:44.288458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37437 (local address 127.0.0.1:57894)
0808 08:38:44.288671 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:44.288793 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 08:38:44.290107 25465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:44.289682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37437 (local address 127.0.0.1:57898)
0808 08:38:44.289886 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:44.289969 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:37437: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260808 08:38:44.316883 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 25275
I20260808 08:38:44.337713 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 24905
I20260808 08:38:44.338922 24972 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:44.451984 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 24905
2026-08-08T08:38:44Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3068 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:38:44 dist-test-slave-chsk krb5kdc[25471](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:38:44 dist-test-slave-chsk krb5kdc[25471](info): set up 2 sockets
Aug 08 08:38:44 dist-test-slave-chsk krb5kdc[25471](info): commencing operation
krb5kdc: starting...
W20260808 08:38:45.631732 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.007s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:38:45 dist-test-slave-chsk krb5kdc[25471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178325, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:38:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:38:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:38:45.960721 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:45969
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:36915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:45969
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:38:46.307436 25485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:46.307741 25485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:46.307906 25485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:46.315237 25485 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:38:46.315363 25485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:46.315485 25485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:46.315593 25485 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:38:46.315657 25485 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:38:46.330608 25485 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:36915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:45969
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:45969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:46.332237 25485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:46.333709 25485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:46.346786 25490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:46.346752 25493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:46.346855 25491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:46.348191 25485 server_base.cc:1034] running on GCE node
I20260808 08:38:46.349061 25485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:46.350582 25485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:46.351830 25485 hybrid_clock.cc:648] HybridClock initialized: now 1786178326351793 us; error 55 us; skew 500 ppm
I20260808 08:38:46.352208 25485 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:38:46 dist-test-slave-chsk krb5kdc[25471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178326, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:38:46.355614 25485 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:38:46.357319 25485 webserver.cc:460] Webserver started at http://127.5.164.254:46039/ using document root <none> and password file <none>
I20260808 08:38:46.358076 25485 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:46.358242 25485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:46.358666 25485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:46.362016 25485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "a788b8b962454413a55c2f9d4a07475c"
format_stamp: "Formatted at 2026-08-08 08:38:46 on dist-test-slave-chsk"
server_key: "177a0da93d5566f44f6683a7dfd1f473"
server_key_iv: "a1c94346419aded8c4836f47fe3bbc5d"
server_key_version: "encryptionkey@0"
I20260808 08:38:46.362861 25485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "a788b8b962454413a55c2f9d4a07475c"
format_stamp: "Formatted at 2026-08-08 08:38:46 on dist-test-slave-chsk"
server_key: "177a0da93d5566f44f6683a7dfd1f473"
server_key_iv: "a1c94346419aded8c4836f47fe3bbc5d"
server_key_version: "encryptionkey@0"
I20260808 08:38:46.368578 25485 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260808 08:38:46.372362 25500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:46.373755 25485 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 08:38:46.373972 25485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "a788b8b962454413a55c2f9d4a07475c"
format_stamp: "Formatted at 2026-08-08 08:38:46 on dist-test-slave-chsk"
server_key: "177a0da93d5566f44f6683a7dfd1f473"
server_key_iv: "a1c94346419aded8c4836f47fe3bbc5d"
server_key_version: "encryptionkey@0"
I20260808 08:38:46.374197 25485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:46.389642 25485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:46.393653 25485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:46.393951 25485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:46.413407 25485 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:45969
I20260808 08:38:46.413441 25555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:45969 every 8 connection(s)
I20260808 08:38:46.414907 25485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:38:46.418592 25556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:46.422979 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 25485
I20260808 08:38:46.423234 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:38:46.423844 5779 external_mini_cluster.cc:1428] Setting key 3d502783177f4cde654ca98df5fbde59
I20260808 08:38:46.430670 25556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c: Bootstrap starting.
I20260808 08:38:46.434496 25556 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:46.435788 25556 log.cc:824] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:46.439463 25556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c: No bootstrap required, opened a new log
Aug 08 08:38:46 dist-test-slave-chsk krb5kdc[25471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178325, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:38:46.447414 25556 raft_consensus.cc:348] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a788b8b962454413a55c2f9d4a07475c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45969 } }
I20260808 08:38:46.447861 25556 raft_consensus.cc:374] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:46.447993 25556 raft_consensus.cc:729] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a788b8b962454413a55c2f9d4a07475c, State: Initialized, Role: FOLLOWER
I20260808 08:38:46.448649 25556 consensus_queue.cc:260] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a788b8b962454413a55c2f9d4a07475c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45969 } }
I20260808 08:38:46.448963 25556 raft_consensus.cc:388] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:38:46.449127 25556 raft_consensus.cc:482] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:38:46.449326 25556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:46.449607 25559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:46.425791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49150 (local address 127.5.164.254:45969)
0808 08:38:46.426638 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:46.426649 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:46.426688 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:38:46.429228 (+ 2540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:46.429253 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:46.429644 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:46.429981 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:46.432054 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:46.433507 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:46.435475 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:46.436239 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:46.436484 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:46.441452 (+ 4968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:46.441460 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:46.441474 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:46.441513 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:46.444861 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:46.445624 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:46.445630 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:46.445640 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:46.445817 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:46.446271 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:46.446277 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:46.446285 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:46.446846 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:46.447198 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:46.447664 (+ 466us) server_negotiation.cc:299] Negotiation successful
0808 08:38:46.448147 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":430,"threads_started":1}
I20260808 08:38:46.452353 25556 raft_consensus.cc:504] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a788b8b962454413a55c2f9d4a07475c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45969 } }
I20260808 08:38:46.452849 25556 leader_election.cc:302] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a788b8b962454413a55c2f9d4a07475c; no voters:
I20260808 08:38:46.453538 25556 leader_election.cc:288] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:38:46.453720 25563 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:38:46.454608 25563 raft_consensus.cc:686] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [term 1 LEADER]: Becoming Leader. State: Replica: a788b8b962454413a55c2f9d4a07475c, State: Running, Role: LEADER
I20260808 08:38:46.455322 25563 consensus_queue.cc:237] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a788b8b962454413a55c2f9d4a07475c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45969 } }
I20260808 08:38:46.456161 25556 sys_catalog.cc:564] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:38:46.458109 25565 sys_catalog.cc:455] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a788b8b962454413a55c2f9d4a07475c. Latest consensus state: current_term: 1 leader_uuid: "a788b8b962454413a55c2f9d4a07475c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a788b8b962454413a55c2f9d4a07475c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45969 } } }
I20260808 08:38:46.458570 25565 sys_catalog.cc:458] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [sys.catalog]: This master's current role is: LEADER
I20260808 08:38:46.460521 25570 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:38:46.460619 25564 sys_catalog.cc:455] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a788b8b962454413a55c2f9d4a07475c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a788b8b962454413a55c2f9d4a07475c" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45969 } } }
I20260808 08:38:46.461110 25564 sys_catalog.cc:458] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c [sys.catalog]: This master's current role is: LEADER
I20260808 08:38:46.470312 25570 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:38:46.480530 25570 catalog_manager.cc:1347] Generated new cluster ID: d46d7b338ff74b1597eb65b9bca7e30a
I20260808 08:38:46.480656 25570 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:38:46.519766 25570 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:38:46.521664 25570 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:38:46.543617 25570 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c: Generated new TSK 0
I20260808 08:38:46.544549 25570 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:38:46.619194 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45969
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:36915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:38:46.966127 25587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:46.966452 25587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:46.966631 25587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:46.974404 25587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:46.974570 25587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:46.974748 25587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:38:46.984997 25587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:36915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45969
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:46.986366 25587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:46.987811 25587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:47.001248 25596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:47.001333 25592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:47.001300 25594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:47.002501 25587 server_base.cc:1034] running on GCE node
I20260808 08:38:47.003191 25587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:47.004160 25587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:47.005367 25587 hybrid_clock.cc:648] HybridClock initialized: now 1786178327005332 us; error 29 us; skew 500 ppm
I20260808 08:38:47.005700 25587 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:38:47 dist-test-slave-chsk krb5kdc[25471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178327, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:38:47.009003 25587 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:38:47.010562 25587 webserver.cc:460] Webserver started at http://127.5.164.193:42979/ using document root <none> and password file <none>
I20260808 08:38:47.011397 25587 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:47.011554 25587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:47.011896 25587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:47.015424 25587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "879c2819432b4afaa4ae14c099d9f25a"
format_stamp: "Formatted at 2026-08-08 08:38:47 on dist-test-slave-chsk"
server_key: "249cfb138f03b438485bedef89e2a696"
server_key_iv: "fcc161eae44187f9bdcba6e6487a40b5"
server_key_version: "encryptionkey@0"
I20260808 08:38:47.016242 25587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "879c2819432b4afaa4ae14c099d9f25a"
format_stamp: "Formatted at 2026-08-08 08:38:47 on dist-test-slave-chsk"
server_key: "249cfb138f03b438485bedef89e2a696"
server_key_iv: "fcc161eae44187f9bdcba6e6487a40b5"
server_key_version: "encryptionkey@0"
I20260808 08:38:47.021422 25587 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:38:47.024904 25604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:47.026175 25587 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:38:47.026362 25587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "879c2819432b4afaa4ae14c099d9f25a"
format_stamp: "Formatted at 2026-08-08 08:38:47 on dist-test-slave-chsk"
server_key: "249cfb138f03b438485bedef89e2a696"
server_key_iv: "fcc161eae44187f9bdcba6e6487a40b5"
server_key_version: "encryptionkey@0"
I20260808 08:38:47.026566 25587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:47.050997 25587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:47.055481 25587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:47.055845 25587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:47.057029 25587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:47.058411 25587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:47.058519 25587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:47.058665 25587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:47.058740 25587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:47.091969 25587 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:44721
I20260808 08:38:47.092032 25724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:44721 every 8 connection(s)
I20260808 08:38:47.093261 25587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:38:47.094161 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 25587
I20260808 08:38:47.094374 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:38:47.094830 5779 external_mini_cluster.cc:1428] Setting key 0eb6d139a5299e126271c7c5a3c88cbc
Aug 08 08:38:47 dist-test-slave-chsk krb5kdc[25471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178327, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:38:47.114711 25727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:47.095916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:50115 (local address 127.5.164.254:45969)
0808 08:38:47.096417 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:47.096421 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:47.097586 (+ 1165us) server_negotiation.cc:407] Connection header received
0808 08:38:47.099464 (+ 1878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:47.099472 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:47.099560 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:47.099681 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:47.101091 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:47.102255 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:47.103830 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:47.104541 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:47.104687 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:47.108078 (+ 3391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:47.108087 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:47.108094 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:47.108146 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:47.111406 (+ 3260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:47.112387 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:47.112391 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:47.112393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:47.112514 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:47.112990 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:47.112993 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:47.112995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:47.113277 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:47.113399 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:47.114280 (+ 881us) server_negotiation.cc:299] Negotiation successful
0808 08:38:47.114451 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":285,"threads_started":1}
I20260808 08:38:47.116376 25729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:47.096530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:45969 (local address 127.5.164.193:50115)
0808 08:38:47.097415 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:47.097460 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:47.099211 (+ 1751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:47.099863 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:47.099870 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:47.100393 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:47.100922 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:47.100939 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:47.102412 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:47.102416 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:47.103697 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:47.103708 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:47.104747 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:47.104752 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:47.104944 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:47.105649 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:38:47.105671 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:47.107864 (+ 2193us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:47.111554 (+ 3690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:47.111565 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:47.111584 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:47.112264 (+ 680us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:47.112620 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:47.112628 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:47.112635 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:47.112878 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:47.113416 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:47.113427 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:47.113871 (+ 444us) client_negotiation.cc:769] Sending connection context
0808 08:38:47.114179 (+ 308us) client_negotiation.cc:240] Negotiation successful
0808 08:38:47.114833 (+ 654us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":360,"threads_started":1}
I20260808 08:38:47.118057 25725 heartbeater.cc:347] Connected to a master server at 127.5.164.254:45969
I20260808 08:38:47.118399 25725 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:47.119093 25725 heartbeater.cc:511] Master 127.5.164.254:45969 requested a full tablet report, sending...
I20260808 08:38:47.121201 25518 ts_manager.cc:194] Registered new tserver with Master: 879c2819432b4afaa4ae14c099d9f25a (127.5.164.193:44721)
I20260808 08:38:47.122622 25518 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:50115
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:38:47.170022 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45969
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:36915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:38:47.504416 25732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:47.504714 25732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:47.504886 25732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:47.512060 25732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:47.512207 25732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:47.512388 25732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:38:47.522176 25732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:36915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45969
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:47.523476 25732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:47.524789 25732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:47.537807 25738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:47.537883 25737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:47.537859 25740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:47.538923 25732 server_base.cc:1034] running on GCE node
I20260808 08:38:47.539644 25732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:47.540596 25732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:47.541821 25732 hybrid_clock.cc:648] HybridClock initialized: now 1786178327541781 us; error 49 us; skew 500 ppm
I20260808 08:38:47.542160 25732 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:38:47 dist-test-slave-chsk krb5kdc[25471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178327, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:38:47.545506 25732 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:38:47.546914 25732 webserver.cc:460] Webserver started at http://127.5.164.194:42787/ using document root <none> and password file <none>
I20260808 08:38:47.547637 25732 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:47.547751 25732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:47.548019 25732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:47.550995 25732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "cd2c8a4becd949b6bef6c15b9793676d"
format_stamp: "Formatted at 2026-08-08 08:38:47 on dist-test-slave-chsk"
server_key: "2bcfeb9ab78f9910c62b8e2f7f2f48ba"
server_key_iv: "5718b3407fa5050157db3bf29cb7d886"
server_key_version: "encryptionkey@0"
I20260808 08:38:47.551818 25732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "cd2c8a4becd949b6bef6c15b9793676d"
format_stamp: "Formatted at 2026-08-08 08:38:47 on dist-test-slave-chsk"
server_key: "2bcfeb9ab78f9910c62b8e2f7f2f48ba"
server_key_iv: "5718b3407fa5050157db3bf29cb7d886"
server_key_version: "encryptionkey@0"
I20260808 08:38:47.556870 25732 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 08:38:47.560465 25748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:47.561671 25732 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:38:47.561834 25732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "cd2c8a4becd949b6bef6c15b9793676d"
format_stamp: "Formatted at 2026-08-08 08:38:47 on dist-test-slave-chsk"
server_key: "2bcfeb9ab78f9910c62b8e2f7f2f48ba"
server_key_iv: "5718b3407fa5050157db3bf29cb7d886"
server_key_version: "encryptionkey@0"
I20260808 08:38:47.562052 25732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:47.575767 25732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:47.579838 25732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:47.580163 25732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:47.581117 25732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:47.582433 25732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:47.582508 25732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:47.582681 25732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:47.582762 25732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:47.616941 25732 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:39801
I20260808 08:38:47.616976 25866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:39801 every 8 connection(s)
I20260808 08:38:47.618371 25732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:38:47.621021 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 25732
I20260808 08:38:47.621260 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:38:47.621846 5779 external_mini_cluster.cc:1428] Setting key 01e5c1b09da5b33aec01a40555056290
Aug 08 08:38:47 dist-test-slave-chsk krb5kdc[25471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178327, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:38:47.642082 25869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:47.620905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:42751 (local address 127.5.164.254:45969)
0808 08:38:47.621468 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:47.621475 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:47.622638 (+ 1163us) server_negotiation.cc:407] Connection header received
0808 08:38:47.625089 (+ 2451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:47.625093 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:47.625157 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:47.625263 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:47.627488 (+ 2225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:47.628245 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:47.630755 (+ 2510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:47.631391 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:47.631491 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:47.635867 (+ 4376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:47.635872 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:47.635875 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:47.635907 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:47.638837 (+ 2930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:47.639664 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:47.639669 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:47.639674 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:47.639844 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:47.640373 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:47.640376 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:47.640378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:47.640632 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:47.640754 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:47.641600 (+ 846us) server_negotiation.cc:299] Negotiation successful
0808 08:38:47.641787 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":287,"threads_started":1}
I20260808 08:38:47.643675 25871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:47.621518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:45969 (local address 127.5.164.194:42751)
0808 08:38:47.622435 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:47.622503 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:47.624776 (+ 2273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:47.625539 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:47.625556 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:47.626401 (+ 845us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:47.627284 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:47.627314 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:47.628420 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:47.628429 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:47.630606 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:47.630624 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:47.631628 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:47.631637 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:47.631973 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:47.632761 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:38:47.632796 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:47.635626 (+ 2830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:47.639012 (+ 3386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:47.639019 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:47.639032 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:47.639524 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:47.639994 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:47.640001 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:47.640008 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:47.640259 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:47.640758 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:47.640768 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:47.641220 (+ 452us) client_negotiation.cc:769] Sending connection context
0808 08:38:47.641523 (+ 303us) client_negotiation.cc:240] Negotiation successful
0808 08:38:47.642137 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":349,"threads_started":1}
I20260808 08:38:47.645195 25867 heartbeater.cc:347] Connected to a master server at 127.5.164.254:45969
I20260808 08:38:47.645529 25867 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:47.646464 25867 heartbeater.cc:511] Master 127.5.164.254:45969 requested a full tablet report, sending...
I20260808 08:38:47.648140 25518 ts_manager.cc:194] Registered new tserver with Master: cd2c8a4becd949b6bef6c15b9793676d (127.5.164.194:39801)
I20260808 08:38:47.648998 25518 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:42751
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:38:47.696188 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45969
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:36915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:38:48.041595 25874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:48.041852 25874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:48.041945 25874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:48.049012 25874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:48.049115 25874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:48.049233 25874 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:38:48.058715 25874 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:36915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:45969
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:48.060016 25874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:48.061249 25874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:48.074694 25879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:48.074642 25882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:48.074604 25880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:48.076148 25874 server_base.cc:1034] running on GCE node
I20260808 08:38:48.076740 25874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:48.077615 25874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:48.078896 25874 hybrid_clock.cc:648] HybridClock initialized: now 1786178328078849 us; error 29 us; skew 500 ppm
I20260808 08:38:48.079213 25874 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:38:48 dist-test-slave-chsk krb5kdc[25471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178328, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:38:48.082381 25874 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:38:48.083894 25874 webserver.cc:460] Webserver started at http://127.5.164.195:37169/ using document root <none> and password file <none>
I20260808 08:38:48.084549 25874 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:48.084688 25874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:48.085017 25874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:48.087909 25874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "331aafc5a6d64a5386802732d1d01792"
format_stamp: "Formatted at 2026-08-08 08:38:48 on dist-test-slave-chsk"
server_key: "42ca78ac6f35b1ee874eabf2eca9daac"
server_key_iv: "78b52831ec105aba40bb9a266e7784d9"
server_key_version: "encryptionkey@0"
I20260808 08:38:48.088688 25874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "331aafc5a6d64a5386802732d1d01792"
format_stamp: "Formatted at 2026-08-08 08:38:48 on dist-test-slave-chsk"
server_key: "42ca78ac6f35b1ee874eabf2eca9daac"
server_key_iv: "78b52831ec105aba40bb9a266e7784d9"
server_key_version: "encryptionkey@0"
I20260808 08:38:48.093750 25874 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:38:48.097090 25889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:48.098358 25874 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:38:48.098528 25874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "331aafc5a6d64a5386802732d1d01792"
format_stamp: "Formatted at 2026-08-08 08:38:48 on dist-test-slave-chsk"
server_key: "42ca78ac6f35b1ee874eabf2eca9daac"
server_key_iv: "78b52831ec105aba40bb9a266e7784d9"
server_key_version: "encryptionkey@0"
I20260808 08:38:48.098721 25874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:48.114272 25874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:48.118319 25874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:48.118620 25874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:48.119705 25874 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:48.121024 25874 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:48.121130 25874 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:48.121296 25874 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:48.121381 25874 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:48.125617 25725 heartbeater.cc:503] Master 127.5.164.254:45969 was elected leader, sending a full tablet report...
I20260808 08:38:48.157265 25874 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:43311
I20260808 08:38:48.157359 26010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:43311 every 8 connection(s)
I20260808 08:38:48.158552 25874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:38:48.167703 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 25874
I20260808 08:38:48.167900 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:38:48.168473 5779 external_mini_cluster.cc:1428] Setting key 68e05286451f9bc4ad6481d8c683f086
Aug 08 08:38:48 dist-test-slave-chsk krb5kdc[25471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178328, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:38:48.178709 26013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.161217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:35017 (local address 127.5.164.254:45969)
0808 08:38:48.161699 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:48.161706 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:48.162730 (+ 1024us) server_negotiation.cc:407] Connection header received
0808 08:38:48.164677 (+ 1947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:48.164681 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:48.164763 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:48.164860 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:48.166413 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.167228 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.169351 (+ 2123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.169765 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.169924 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.173417 (+ 3493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:48.173422 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:48.173425 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:48.173456 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:48.176085 (+ 2629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:48.176719 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:48.176723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:48.176725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:48.176838 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:48.177210 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:48.177213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:48.177215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:48.177466 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:48.177576 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:48.178220 (+ 644us) server_negotiation.cc:299] Negotiation successful
0808 08:38:48.178406 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":233,"threads_started":1}
I20260808 08:38:48.179806 26014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.161810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:45969 (local address 127.5.164.195:35017)
0808 08:38:48.162575 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:48.162615 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:48.164390 (+ 1775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:48.165052 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:48.165060 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:48.165632 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:48.166266 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:48.166284 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.167390 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.167397 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:48.169201 (+ 1804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:48.169213 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.169985 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.169990 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:48.170267 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.170974 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:38:48.170996 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:48.173224 (+ 2228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:48.176208 (+ 2984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:48.176214 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:48.176225 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:48.176620 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:48.176938 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:48.176941 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:48.176943 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:48.177108 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:48.177569 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:48.177574 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:48.177853 (+ 279us) client_negotiation.cc:769] Sending connection context
0808 08:38:48.178125 (+ 272us) client_negotiation.cc:240] Negotiation successful
0808 08:38:48.178584 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":319,"threads_started":1}
I20260808 08:38:48.181066 26011 heartbeater.cc:347] Connected to a master server at 127.5.164.254:45969
I20260808 08:38:48.181408 26011 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:48.182353 26011 heartbeater.cc:511] Master 127.5.164.254:45969 requested a full tablet report, sending...
I20260808 08:38:48.183949 25518 ts_manager.cc:194] Registered new tserver with Master: 331aafc5a6d64a5386802732d1d01792 (127.5.164.195:43311)
I20260808 08:38:48.184710 25518 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:35017
I20260808 08:38:48.195885 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:38:48.212733 26013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.200046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46808 (local address 127.5.164.254:45969)
0808 08:38:48.200198 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:48.200203 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:48.200747 (+ 544us) server_negotiation.cc:407] Connection header received
0808 08:38:48.200880 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:48.200883 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:48.200952 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:48.201030 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:48.202519 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.203338 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.204680 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.205055 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.205149 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.207849 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:48.207854 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:48.207857 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:48.207884 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:48.210283 (+ 2399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:48.210989 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:48.210993 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:48.210995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:48.211101 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:48.211530 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:48.211533 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:48.211535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:48.211822 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:48.212061 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:48.212352 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 08:38:48.212493 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 08:38:48.216619 25518 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46808:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:38:48.223457 25518 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:38:48.258386 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.235567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37990 (local address 127.5.164.195:43311)
0808 08:38:48.246499 (+ 10932us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:48.246508 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:48.247382 (+ 874us) server_negotiation.cc:407] Connection header received
0808 08:38:48.247737 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:48.247746 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:48.247978 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:48.248166 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:48.249030 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.251178 (+ 2148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.255571 (+ 4393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.257217 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.257371 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.257593 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:48.257873 (+ 280us) server_negotiation.cc:299] Negotiation successful
0808 08:38:48.258039 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10734,"thread_start_us":10559,"threads_started":1}
I20260808 08:38:48.258387 26027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.235688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34870 (local address 127.5.164.194:39801)
0808 08:38:48.246489 (+ 10801us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:48.246501 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:48.247286 (+ 785us) server_negotiation.cc:407] Connection header received
0808 08:38:48.247572 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:48.247583 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:48.247846 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:48.248050 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:48.249284 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.251243 (+ 1959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.255226 (+ 3983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.256794 (+ 1568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.256955 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.257178 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:48.257870 (+ 692us) server_negotiation.cc:299] Negotiation successful
0808 08:38:48.258039 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10633,"thread_start_us":10515,"threads_started":1}
I20260808 08:38:48.259111 26025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.235441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:39801 (local address 127.0.0.1:34870)
0808 08:38:48.246973 (+ 11532us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:48.247025 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:48.247301 (+ 276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:48.248371 (+ 1070us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:48.248384 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:48.248437 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:48.249054 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:48.249071 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.251450 (+ 2379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.251458 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:48.254991 (+ 3533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:48.255005 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.257081 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.257089 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:48.257395 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.257453 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 08:38:48.257610 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 08:38:48.258779 (+ 1169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11390,"mutex_wait_us":94,"spinlock_wait_cycles":51840,"thread_start_us":11223,"threads_started":1}
I20260808 08:38:48.259701 26024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.235302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:43311 (local address 127.0.0.1:37990)
0808 08:38:48.246973 (+ 11671us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:48.247027 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:48.247527 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:48.248439 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:48.248442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:48.248462 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:48.248831 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:48.248841 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.251426 (+ 2585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.251434 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:48.255374 (+ 3940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:48.255389 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.257451 (+ 2062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.257458 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:48.257683 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.257720 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 08:38:48.257830 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 08:38:48.258979 (+ 1149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11409,"mutex_wait_us":1031,"spinlock_wait_cycles":6400,"thread_start_us":11227,"threads_started":1}
I20260808 08:38:48.262888 25800 tablet_service.cc:1467] Processing CreateTablet for tablet d422f31713df46bfad7fb9c585ca49cf (DEFAULT_TABLE table=test-table [id=fba3f876f58c43cf8541bdd9313955a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:48.263057 25943 tablet_service.cc:1467] Processing CreateTablet for tablet d422f31713df46bfad7fb9c585ca49cf (DEFAULT_TABLE table=test-table [id=fba3f876f58c43cf8541bdd9313955a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:48.264225 26030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.249186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:44721 (local address 127.0.0.1:59964)
0808 08:38:48.253278 (+ 4092us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:48.253299 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:48.253432 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:48.254080 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:48.254085 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:48.254112 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:48.254657 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:48.254670 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.256657 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.256662 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:48.258590 (+ 1928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:48.258610 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.263348 (+ 4738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.263356 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:48.263529 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.263565 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 08:38:48.263673 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 08:38:48.263810 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3965,"mutex_wait_us":26,"thread_start_us":4365,"threads_started":1}
I20260808 08:38:48.264510 25800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d422f31713df46bfad7fb9c585ca49cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:48.264611 25943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d422f31713df46bfad7fb9c585ca49cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:48.265019 26029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.247856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59964 (local address 127.5.164.193:44721)
0808 08:38:48.252555 (+ 4699us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:48.252565 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:48.253409 (+ 844us) server_negotiation.cc:407] Connection header received
0808 08:38:48.253640 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:48.253652 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:48.253882 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:48.254086 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:48.254854 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.256502 (+ 1648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.258794 (+ 2292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.260356 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.260524 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.263577 (+ 3053us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:48.263880 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 08:38:48.264055 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4504,"thread_start_us":4331,"threads_started":1}
I20260808 08:38:48.268831 25656 tablet_service.cc:1467] Processing CreateTablet for tablet d422f31713df46bfad7fb9c585ca49cf (DEFAULT_TABLE table=test-table [id=fba3f876f58c43cf8541bdd9313955a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:48.270253 25656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d422f31713df46bfad7fb9c585ca49cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:48.277200 26031 tablet_bootstrap.cc:492] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d: Bootstrap starting.
I20260808 08:38:48.279274 26032 tablet_bootstrap.cc:492] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792: Bootstrap starting.
I20260808 08:38:48.282382 26031 tablet_bootstrap.cc:654] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:48.283331 26033 tablet_bootstrap.cc:492] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a: Bootstrap starting.
I20260808 08:38:48.283427 26032 tablet_bootstrap.cc:654] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:48.283831 26031 log.cc:824] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:48.284983 26032 log.cc:824] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:48.286732 26033 tablet_bootstrap.cc:654] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:48.287094 26031 tablet_bootstrap.cc:492] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d: No bootstrap required, opened a new log
I20260808 08:38:48.287393 26031 ts_tablet_manager.cc:1397] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.002s
I20260808 08:38:48.287822 26033 log.cc:824] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:48.289323 26032 tablet_bootstrap.cc:492] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792: No bootstrap required, opened a new log
I20260808 08:38:48.289588 26032 ts_tablet_manager.cc:1397] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260808 08:38:48.290683 26033 tablet_bootstrap.cc:492] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a: No bootstrap required, opened a new log
I20260808 08:38:48.290934 26033 ts_tablet_manager.cc:1397] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260808 08:38:48.296471 26032 raft_consensus.cc:348] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "331aafc5a6d64a5386802732d1d01792" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43311 } } peers { permanent_uuid: "cd2c8a4becd949b6bef6c15b9793676d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 39801 } } peers { permanent_uuid: "879c2819432b4afaa4ae14c099d9f25a" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44721 } }
I20260808 08:38:48.296830 26032 raft_consensus.cc:374] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:48.296957 26032 raft_consensus.cc:729] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 331aafc5a6d64a5386802732d1d01792, State: Initialized, Role: FOLLOWER
I20260808 08:38:48.297610 26032 consensus_queue.cc:260] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "331aafc5a6d64a5386802732d1d01792" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43311 } } peers { permanent_uuid: "cd2c8a4becd949b6bef6c15b9793676d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 39801 } } peers { permanent_uuid: "879c2819432b4afaa4ae14c099d9f25a" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44721 } }
I20260808 08:38:48.297894 26031 raft_consensus.cc:348] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "331aafc5a6d64a5386802732d1d01792" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43311 } } peers { permanent_uuid: "cd2c8a4becd949b6bef6c15b9793676d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 39801 } } peers { permanent_uuid: "879c2819432b4afaa4ae14c099d9f25a" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44721 } }
I20260808 08:38:48.298388 26031 raft_consensus.cc:374] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:48.298755 26011 heartbeater.cc:503] Master 127.5.164.254:45969 was elected leader, sending a full tablet report...
I20260808 08:38:48.299445 26032 ts_tablet_manager.cc:1428] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792: Time spent starting tablet: real 0.010s user 0.007s sys 0.003s
I20260808 08:38:48.298547 26031 raft_consensus.cc:729] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd2c8a4becd949b6bef6c15b9793676d, State: Initialized, Role: FOLLOWER
I20260808 08:38:48.300122 26031 consensus_queue.cc:260] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "331aafc5a6d64a5386802732d1d01792" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43311 } } peers { permanent_uuid: "cd2c8a4becd949b6bef6c15b9793676d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 39801 } } peers { permanent_uuid: "879c2819432b4afaa4ae14c099d9f25a" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44721 } }
I20260808 08:38:48.301215 25867 heartbeater.cc:503] Master 127.5.164.254:45969 was elected leader, sending a full tablet report...
I20260808 08:38:48.301846 26031 ts_tablet_manager.cc:1428] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d: Time spent starting tablet: real 0.014s user 0.009s sys 0.003s
I20260808 08:38:48.302824 26033 raft_consensus.cc:348] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "331aafc5a6d64a5386802732d1d01792" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43311 } } peers { permanent_uuid: "cd2c8a4becd949b6bef6c15b9793676d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 39801 } } peers { permanent_uuid: "879c2819432b4afaa4ae14c099d9f25a" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44721 } }
I20260808 08:38:48.303311 26033 raft_consensus.cc:374] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:48.303453 26033 raft_consensus.cc:729] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 879c2819432b4afaa4ae14c099d9f25a, State: Initialized, Role: FOLLOWER
I20260808 08:38:48.304049 26033 consensus_queue.cc:260] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "331aafc5a6d64a5386802732d1d01792" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43311 } } peers { permanent_uuid: "cd2c8a4becd949b6bef6c15b9793676d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 39801 } } peers { permanent_uuid: "879c2819432b4afaa4ae14c099d9f25a" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44721 } }
I20260808 08:38:48.305766 26033 ts_tablet_manager.cc:1428] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
W20260808 08:38:48.345660 25726 tablet.cc:2369] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:38:48.370335 25868 tablet.cc:2369] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:38:48.410364 26012 tablet.cc:2369] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:38:48.435998 26039 raft_consensus.cc:482] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:38:48.436368 26039 raft_consensus.cc:504] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "331aafc5a6d64a5386802732d1d01792" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43311 } } peers { permanent_uuid: "cd2c8a4becd949b6bef6c15b9793676d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 39801 } } peers { permanent_uuid: "879c2819432b4afaa4ae14c099d9f25a" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44721 } }
I20260808 08:38:48.438160 26039 leader_election.cc:288] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 331aafc5a6d64a5386802732d1d01792 (127.5.164.195:43311), cd2c8a4becd949b6bef6c15b9793676d (127.5.164.194:39801)
I20260808 08:38:48.445801 26027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.439224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:57995 (local address 127.5.164.194:39801)
0808 08:38:48.439449 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:48.439455 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:48.440208 (+ 753us) server_negotiation.cc:407] Connection header received
0808 08:38:48.440534 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:48.440538 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:48.440600 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:48.440714 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:48.441360 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.442105 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.444026 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.444798 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.444921 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.445048 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:48.445389 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 08:38:48.445520 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:38:48.445827 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.438664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:38685 (local address 127.5.164.195:43311)
0808 08:38:48.438901 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:48.438910 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:48.440052 (+ 1142us) server_negotiation.cc:407] Connection header received
0808 08:38:48.440317 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:48.440323 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:48.440410 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:48.440481 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:48.441351 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.442109 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.444084 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.444842 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.445040 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.445117 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:48.445426 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 08:38:48.445552 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 08:38:48.445981 26040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.438599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:43311 (local address 127.5.164.193:38685)
0808 08:38:48.439909 (+ 1310us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:48.439933 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:48.440109 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:48.440671 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:48.440678 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:48.440708 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:48.441189 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:48.441201 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.442275 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.442279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:48.443902 (+ 1623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:48.443915 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.445114 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.445119 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:48.445242 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.445264 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 08:38:48.445377 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 08:38:48.445508 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1169,"mutex_wait_us":4,"thread_start_us":890,"threads_started":1}
I20260808 08:38:48.446003 26041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.438721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:39801 (local address 127.5.164.193:57995)
0808 08:38:48.440090 (+ 1369us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:48.440114 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:48.440321 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:48.440727 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:48.440732 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:48.440756 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:48.441190 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:48.441200 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.442247 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.442255 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:48.443859 (+ 1604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:48.443871 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.445018 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.445025 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:48.445220 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.445245 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 08:38:48.445322 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 08:38:48.445466 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1227,"mutex_wait_us":62,"thread_start_us":1507,"threads_started":1}
I20260808 08:38:48.447292 25963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d422f31713df46bfad7fb9c585ca49cf" candidate_uuid: "879c2819432b4afaa4ae14c099d9f25a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "331aafc5a6d64a5386802732d1d01792" is_pre_election: true
I20260808 08:38:48.447292 25820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d422f31713df46bfad7fb9c585ca49cf" candidate_uuid: "879c2819432b4afaa4ae14c099d9f25a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd2c8a4becd949b6bef6c15b9793676d" is_pre_election: true
I20260808 08:38:48.447888 25963 raft_consensus.cc:2454] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879c2819432b4afaa4ae14c099d9f25a in term 0.
I20260808 08:38:48.447896 25820 raft_consensus.cc:2454] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 879c2819432b4afaa4ae14c099d9f25a in term 0.
I20260808 08:38:48.448585 25608 leader_election.cc:302] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 879c2819432b4afaa4ae14c099d9f25a, cd2c8a4becd949b6bef6c15b9793676d; no voters:
I20260808 08:38:48.449012 26039 raft_consensus.cc:2781] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:38:48.449193 26039 raft_consensus.cc:482] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:38:48.449313 26039 raft_consensus.cc:3037] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:48.451678 26039 raft_consensus.cc:504] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "331aafc5a6d64a5386802732d1d01792" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43311 } } peers { permanent_uuid: "cd2c8a4becd949b6bef6c15b9793676d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 39801 } } peers { permanent_uuid: "879c2819432b4afaa4ae14c099d9f25a" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44721 } }
I20260808 08:38:48.452342 26039 leader_election.cc:288] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [CANDIDATE]: Term 1 election: Requested vote from peers 331aafc5a6d64a5386802732d1d01792 (127.5.164.195:43311), cd2c8a4becd949b6bef6c15b9793676d (127.5.164.194:39801)
I20260808 08:38:48.452769 25963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d422f31713df46bfad7fb9c585ca49cf" candidate_uuid: "879c2819432b4afaa4ae14c099d9f25a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "331aafc5a6d64a5386802732d1d01792"
I20260808 08:38:48.452898 25820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d422f31713df46bfad7fb9c585ca49cf" candidate_uuid: "879c2819432b4afaa4ae14c099d9f25a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd2c8a4becd949b6bef6c15b9793676d"
I20260808 08:38:48.452980 25963 raft_consensus.cc:3037] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:48.453138 25820 raft_consensus.cc:3037] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:48.455261 25963 raft_consensus.cc:2454] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879c2819432b4afaa4ae14c099d9f25a in term 1.
I20260808 08:38:48.455447 25820 raft_consensus.cc:2454] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 879c2819432b4afaa4ae14c099d9f25a in term 1.
I20260808 08:38:48.455796 25605 leader_election.cc:302] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 331aafc5a6d64a5386802732d1d01792, 879c2819432b4afaa4ae14c099d9f25a; no voters:
I20260808 08:38:48.456171 26039 raft_consensus.cc:2781] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:38:48.456589 26039 raft_consensus.cc:686] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [term 1 LEADER]: Becoming Leader. State: Replica: 879c2819432b4afaa4ae14c099d9f25a, State: Running, Role: LEADER
I20260808 08:38:48.457147 26039 consensus_queue.cc:237] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "331aafc5a6d64a5386802732d1d01792" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43311 } } peers { permanent_uuid: "cd2c8a4becd949b6bef6c15b9793676d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 39801 } } peers { permanent_uuid: "879c2819432b4afaa4ae14c099d9f25a" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44721 } }
I20260808 08:38:48.461551 25518 catalog_manager.cc:5495] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a reported cstate change: term changed from 0 to 1, leader changed from <none> to 879c2819432b4afaa4ae14c099d9f25a (127.5.164.193). New cstate: current_term: 1 leader_uuid: "879c2819432b4afaa4ae14c099d9f25a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "331aafc5a6d64a5386802732d1d01792" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd2c8a4becd949b6bef6c15b9793676d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "879c2819432b4afaa4ae14c099d9f25a" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 44721 } health_report { overall_health: HEALTHY } } }
I20260808 08:38:48.498195 26029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.492482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59978 (local address 127.5.164.193:44721)
0808 08:38:48.492699 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:48.492706 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:48.492814 (+ 108us) server_negotiation.cc:407] Connection header received
0808 08:38:48.493054 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:48.493058 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:48.493141 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:48.493315 (+ 174us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:38:48.493721 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.494443 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.495859 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.496256 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.496399 (+ 143us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.496996 (+ 597us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:38:48.497537 (+ 541us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:38:48.497738 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:48.497894 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 08:38:48.497941 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 08:38:48.506582 25820 raft_consensus.cc:1261] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d [term 1 FOLLOWER]: Refusing update from remote peer 879c2819432b4afaa4ae14c099d9f25a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:38:48.506582 25963 raft_consensus.cc:1261] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792 [term 1 FOLLOWER]: Refusing update from remote peer 879c2819432b4afaa4ae14c099d9f25a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:38:48.507551 26042 consensus_queue.cc:1035] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "331aafc5a6d64a5386802732d1d01792" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 43311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:38:48.507954 26039 consensus_queue.cc:1035] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd2c8a4becd949b6bef6c15b9793676d" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:38:48.520365 26047 mvcc.cc:205] Tried to move back new op lower bound from 7316186433553440768 to 7316186433364111360. Current Snapshot: MvccSnapshot[applied={T|T < 7316186433553440768}]
I20260808 08:38:48.523644 26045 mvcc.cc:205] Tried to move back new op lower bound from 7316186433553440768 to 7316186433364111360. Current Snapshot: MvccSnapshot[applied={T|T < 7316186433553440768 or (T in {7316186433553440768})}]
I20260808 08:38:48.527081 26046 mvcc.cc:205] Tried to move back new op lower bound from 7316186433553440768 to 7316186433364111360. Current Snapshot: MvccSnapshot[applied={T|T < 7316186433553440768}]
I20260808 08:38:48.535543 25517 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46808:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:38:48.535857 25517 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46808:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:38:48.540015 25517 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a788b8b962454413a55c2f9d4a07475c: Sending DeleteTablet for 3 replicas of tablet d422f31713df46bfad7fb9c585ca49cf
I20260808 08:38:48.541271 25943 tablet_service.cc:1514] Processing DeleteTablet for tablet d422f31713df46bfad7fb9c585ca49cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:48 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:37990
I20260808 08:38:48.541402 25656 tablet_service.cc:1514] Processing DeleteTablet for tablet d422f31713df46bfad7fb9c585ca49cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:48 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:59964
I20260808 08:38:48.541404 25800 tablet_service.cc:1514] Processing DeleteTablet for tablet d422f31713df46bfad7fb9c585ca49cf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:48 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:34870
I20260808 08:38:48.543658 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 25587
I20260808 08:38:48.555477 26057 tablet_replica.cc:330] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a: stopping tablet replica
I20260808 08:38:48.556186 26057 raft_consensus.cc:2229] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:38:48.557312 26057 raft_consensus.cc:2258] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:38:48.559741 26056 tablet_replica.cc:330] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d: stopping tablet replica
I20260808 08:38:48.559973 26055 tablet_replica.cc:330] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792: stopping tablet replica
I20260808 08:38:48.560163 26056 raft_consensus.cc:2229] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:38:48.560416 26057 ts_tablet_manager.cc:1905] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:38:48.560497 26055 raft_consensus.cc:2229] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:38:48.560711 26056 raft_consensus.cc:2258] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:38:48.561105 26055 raft_consensus.cc:2258] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:38:48.562871 26056 ts_tablet_manager.cc:1905] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 08 08:38:48 dist-test-slave-chsk krb5kdc[25471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178325, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:38:48.568621 26057 ts_tablet_manager.cc:1918] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:48.568866 26057 log.cc:1196] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/d422f31713df46bfad7fb9c585ca49cf
I20260808 08:38:48.569442 26057 ts_tablet_manager.cc:1939] T d422f31713df46bfad7fb9c585ca49cf P 879c2819432b4afaa4ae14c099d9f25a: Deleting consensus metadata
I20260808 08:38:48.570216 26056 ts_tablet_manager.cc:1918] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:48.570786 26056 log.cc:1196] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/d422f31713df46bfad7fb9c585ca49cf
I20260808 08:38:48.571555 25504 catalog_manager.cc:4841] TS 879c2819432b4afaa4ae14c099d9f25a (127.5.164.193:44721): tablet d422f31713df46bfad7fb9c585ca49cf (table test-table [id=fba3f876f58c43cf8541bdd9313955a0]) successfully deleted
I20260808 08:38:48.571728 26056 ts_tablet_manager.cc:1939] T d422f31713df46bfad7fb9c585ca49cf P cd2c8a4becd949b6bef6c15b9793676d: Deleting consensus metadata
I20260808 08:38:48.573467 26055 ts_tablet_manager.cc:1905] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:38:48.573469 25504 catalog_manager.cc:4841] TS cd2c8a4becd949b6bef6c15b9793676d (127.5.164.194:39801): tablet d422f31713df46bfad7fb9c585ca49cf (table test-table [id=fba3f876f58c43cf8541bdd9313955a0]) successfully deleted
I20260808 08:38:48.575425 26029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.545041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59984 (local address 127.5.164.193:44721)
0808 08:38:48.545220 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:48.545227 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:48.550953 (+ 5726us) server_negotiation.cc:407] Connection header received
0808 08:38:48.551221 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:48.551229 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:48.551314 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:48.551401 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:48.554082 (+ 2681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.555376 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.559811 (+ 4435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.560523 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.560623 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.566695 (+ 6072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:48.566710 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:48.566729 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:48.566783 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:48.571040 (+ 4257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:48.572568 (+ 1528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:48.572580 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:48.572587 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:48.572789 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:48.573322 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:48.573328 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:48.573331 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:48.573791 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:48.574104 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:48.574543 (+ 439us) server_negotiation.cc:299] Negotiation successful
0808 08:38:48.574794 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:38:48.576421 25719 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:48.581635 26055 ts_tablet_manager.cc:1918] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:48.581807 26055 log.cc:1196] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/d422f31713df46bfad7fb9c585ca49cf
I20260808 08:38:48.582381 26055 ts_tablet_manager.cc:1939] T d422f31713df46bfad7fb9c585ca49cf P 331aafc5a6d64a5386802732d1d01792: Deleting consensus metadata
I20260808 08:38:48.584211 25501 catalog_manager.cc:4841] TS 331aafc5a6d64a5386802732d1d01792 (127.5.164.195:43311): tablet d422f31713df46bfad7fb9c585ca49cf (table test-table [id=fba3f876f58c43cf8541bdd9313955a0]) successfully deleted
I20260808 08:38:48.678792 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 25587
I20260808 08:38:48.700102 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 25732
Aug 08 08:38:48 dist-test-slave-chsk krb5kdc[25471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178325, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:38:48.715728 26027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.700984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34876 (local address 127.5.164.194:39801)
0808 08:38:48.701168 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:48.701172 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:48.701191 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:38:48.701294 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:48.701298 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:48.701371 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:48.701455 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:48.702852 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.703732 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.705075 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.705439 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.705579 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.709914 (+ 4335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:48.709929 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:48.709945 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:48.709977 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:48.712901 (+ 2924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:48.713606 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:48.713614 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:48.713616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:48.713746 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:48.714120 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:48.714126 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:48.714129 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:48.714507 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:48.714820 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:48.715166 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 08:38:48.715389 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 08:38:48.716451 25862 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:48.806883 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 25732
I20260808 08:38:48.828605 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 25874
Aug 08 08:38:48 dist-test-slave-chsk krb5kdc[25471](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178325, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:38:48.844218 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:48.829425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38002 (local address 127.5.164.195:43311)
0808 08:38:48.829627 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:48.829633 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:48.829655 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:38:48.829768 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:48.829773 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:48.829838 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:48.829962 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:48.831328 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.832052 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.833372 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:48.833791 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:48.833922 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:48.838559 (+ 4637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:48.838576 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:48.838592 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:48.838626 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:48.841289 (+ 2663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:48.842078 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:48.842086 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:48.842088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:48.842234 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:48.842614 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:48.842619 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:48.842624 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:48.842973 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:48.843318 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:48.843615 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 08:38:48.843842 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:38:48.844864 26006 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:48.937130 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 25874
I20260808 08:38:48.957376 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 25485
I20260808 08:38:48.958585 25551 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:49.070837 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 25485
2026-08-08T08:38:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4620 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T08:38:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:38:49Z Disabled control of system clock
I20260808 08:38:49.168021 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:37903
--webserver_interface=127.5.164.254
--webserver_port=0
--builtin_ntp_servers=127.5.164.212:35475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:37903
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:38:49.517639 26066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:49.517930 26066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:49.518090 26066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:49.525318 26066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:38:49.525465 26066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:49.525537 26066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:49.525640 26066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:38:49.525727 26066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:38:49.535043 26066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:35475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:37903
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:37903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:49.536394 26066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:49.538354 26066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:49.550501 26073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:49.550576 26075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:49.550938 26072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:49.551321 26066 server_base.cc:1034] running on GCE node
I20260808 08:38:49.552032 26066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:49.553359 26066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:49.554605 26066 hybrid_clock.cc:648] HybridClock initialized: now 1786178329554544 us; error 27 us; skew 500 ppm
I20260808 08:38:49.554908 26066 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:38:49.562312 26066 webserver.cc:460] Webserver started at http://127.5.164.254:39455/ using document root <none> and password file <none>
I20260808 08:38:49.562983 26066 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:49.563079 26066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:49.563446 26066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:49.566346 26066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "811e59abdb0848bda0a390ea39b4d80a"
format_stamp: "Formatted at 2026-08-08 08:38:49 on dist-test-slave-chsk"
server_key: "66b159ca2013d77a4618230c48a2284a"
server_key_iv: "84e361a4118b49ade4e3f65b64eac6a2"
server_key_version: "encryptionkey@0"
I20260808 08:38:49.567185 26066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "811e59abdb0848bda0a390ea39b4d80a"
format_stamp: "Formatted at 2026-08-08 08:38:49 on dist-test-slave-chsk"
server_key: "66b159ca2013d77a4618230c48a2284a"
server_key_iv: "84e361a4118b49ade4e3f65b64eac6a2"
server_key_version: "encryptionkey@0"
I20260808 08:38:49.572405 26066 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 08:38:49.575816 26081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:49.577162 26066 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:38:49.577363 26066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "811e59abdb0848bda0a390ea39b4d80a"
format_stamp: "Formatted at 2026-08-08 08:38:49 on dist-test-slave-chsk"
server_key: "66b159ca2013d77a4618230c48a2284a"
server_key_iv: "84e361a4118b49ade4e3f65b64eac6a2"
server_key_version: "encryptionkey@0"
I20260808 08:38:49.577592 26066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:49.609095 26066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:49.609984 26066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:49.610319 26066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:49.629662 26066 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:37903
I20260808 08:38:49.629629 26136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:37903 every 8 connection(s)
I20260808 08:38:49.631032 26066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:38:49.634793 26137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:49.639966 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 26066
I20260808 08:38:49.640260 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:38:49.640713 5779 external_mini_cluster.cc:1428] Setting key 4c9b73e00a39fd506c32092662880260
I20260808 08:38:49.646153 26137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a: Bootstrap starting.
I20260808 08:38:49.649415 26137 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:49.650465 26137 log.cc:824] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:49.653802 26137 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a: No bootstrap required, opened a new log
I20260808 08:38:49.654724 26140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:49.642735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34982 (local address 127.5.164.254:37903)
0808 08:38:49.643996 (+ 1261us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:49.644007 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:49.644053 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:38:49.645771 (+ 1718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:49.645792 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:49.646234 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:49.646667 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:49.647237 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:49.648552 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:49.650077 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:49.650820 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:49.651023 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:49.652364 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:49.652371 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:49.652384 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:49.652950 (+ 566us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:49.653033 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:49.653054 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:49.653152 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:49.653395 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 08:38:49.653744 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":663,"thread_start_us":415,"threads_started":1}
I20260808 08:38:49.662911 26137 raft_consensus.cc:348] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811e59abdb0848bda0a390ea39b4d80a" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37903 } }
I20260808 08:38:49.663450 26137 raft_consensus.cc:374] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:49.663595 26137 raft_consensus.cc:729] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 811e59abdb0848bda0a390ea39b4d80a, State: Initialized, Role: FOLLOWER
I20260808 08:38:49.664191 26137 consensus_queue.cc:260] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811e59abdb0848bda0a390ea39b4d80a" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37903 } }
I20260808 08:38:49.664453 26137 raft_consensus.cc:388] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:38:49.664610 26137 raft_consensus.cc:482] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:38:49.664793 26137 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:49.667626 26137 raft_consensus.cc:504] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811e59abdb0848bda0a390ea39b4d80a" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37903 } }
I20260808 08:38:49.668196 26137 leader_election.cc:302] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 811e59abdb0848bda0a390ea39b4d80a; no voters:
I20260808 08:38:49.668864 26137 leader_election.cc:288] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:38:49.669011 26143 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:38:49.669991 26143 raft_consensus.cc:686] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [term 1 LEADER]: Becoming Leader. State: Replica: 811e59abdb0848bda0a390ea39b4d80a, State: Running, Role: LEADER
I20260808 08:38:49.671104 26143 consensus_queue.cc:237] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811e59abdb0848bda0a390ea39b4d80a" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37903 } }
I20260808 08:38:49.671517 26137 sys_catalog.cc:564] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:38:49.674206 26144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "811e59abdb0848bda0a390ea39b4d80a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811e59abdb0848bda0a390ea39b4d80a" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37903 } } }
I20260808 08:38:49.674695 26144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [sys.catalog]: This master's current role is: LEADER
I20260808 08:38:49.675181 26145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 811e59abdb0848bda0a390ea39b4d80a. Latest consensus state: current_term: 1 leader_uuid: "811e59abdb0848bda0a390ea39b4d80a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "811e59abdb0848bda0a390ea39b4d80a" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 37903 } } }
I20260808 08:38:49.675485 26145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a [sys.catalog]: This master's current role is: LEADER
I20260808 08:38:49.679634 26152 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:38:49.684307 26152 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:38:49.692737 26152 catalog_manager.cc:1347] Generated new cluster ID: 78751f2f3cf74a20900ce4f76327a1a8
I20260808 08:38:49.692865 26152 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:38:49.705171 26152 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:38:49.706508 26152 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:38:49.719492 26152 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a: Generated new TSK 0
I20260808 08:38:49.720359 26152 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:38:49.736203 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37903
--builtin_ntp_servers=127.5.164.212:35475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:38:50.085762 26164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:50.086063 26164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:50.086236 26164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:50.093433 26164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:50.093562 26164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:50.093737 26164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:38:50.102584 26164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:35475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37903
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:50.103946 26164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:50.105767 26164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:50.118747 26169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:50.118839 26171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:50.118870 26173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:50.119958 26164 server_base.cc:1034] running on GCE node
I20260808 08:38:50.120538 26164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:50.121440 26164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:50.122681 26164 hybrid_clock.cc:648] HybridClock initialized: now 1786178330122642 us; error 53 us; skew 500 ppm
I20260808 08:38:50.122991 26164 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:38:50.125244 26164 webserver.cc:460] Webserver started at http://127.5.164.193:37739/ using document root <none> and password file <none>
I20260808 08:38:50.125898 26164 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:50.126034 26164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:50.126365 26164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:50.129232 26164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "094bcd195a4c4b449b9e5cb857a6fbdc"
format_stamp: "Formatted at 2026-08-08 08:38:50 on dist-test-slave-chsk"
server_key: "0fb29f7bf39bc8d33e9e65cb8054fa43"
server_key_iv: "dcb21c3f57238b07e9f0b23179a18c9c"
server_key_version: "encryptionkey@0"
I20260808 08:38:50.130115 26164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "094bcd195a4c4b449b9e5cb857a6fbdc"
format_stamp: "Formatted at 2026-08-08 08:38:50 on dist-test-slave-chsk"
server_key: "0fb29f7bf39bc8d33e9e65cb8054fa43"
server_key_iv: "dcb21c3f57238b07e9f0b23179a18c9c"
server_key_version: "encryptionkey@0"
I20260808 08:38:50.135020 26164 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260808 08:38:50.138445 26179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:50.139709 26164 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:38:50.139878 26164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "094bcd195a4c4b449b9e5cb857a6fbdc"
format_stamp: "Formatted at 2026-08-08 08:38:50 on dist-test-slave-chsk"
server_key: "0fb29f7bf39bc8d33e9e65cb8054fa43"
server_key_iv: "dcb21c3f57238b07e9f0b23179a18c9c"
server_key_version: "encryptionkey@0"
I20260808 08:38:50.140095 26164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:50.163772 26164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:50.164531 26164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:50.164837 26164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:50.165762 26164 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:50.167207 26164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:50.167318 26164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:50.167443 26164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:50.167531 26164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:50.200631 26164 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:35701
I20260808 08:38:50.200718 26302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:35701 every 8 connection(s)
I20260808 08:38:50.201977 26164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:38:50.211273 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 26164
I20260808 08:38:50.211442 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:38:50.211882 5779 external_mini_cluster.cc:1428] Setting key 2598b551d9b1e2f914b44fe1aa7ed069
I20260808 08:38:50.214790 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:50.204546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:33287 (local address 127.5.164.254:37903)
0808 08:38:50.205039 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:50.205044 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:50.206038 (+ 994us) server_negotiation.cc:407] Connection header received
0808 08:38:50.208003 (+ 1965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:50.208009 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:50.208094 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:50.208230 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:50.209274 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:50.210020 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:50.211772 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:50.212279 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:50.212427 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:50.213911 (+ 1484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:50.213916 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:50.213919 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:50.213936 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:50.213977 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:50.213989 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:50.214085 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:50.214319 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 08:38:50.214419 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":275,"threads_started":1}
I20260808 08:38:50.214777 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37903
--builtin_ntp_servers=127.5.164.212:35475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:38:50.215871 26306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:50.205018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37903 (local address 127.5.164.193:33287)
0808 08:38:50.205878 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:50.205919 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:50.207699 (+ 1780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:50.208459 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:50.208466 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:50.208555 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:50.209102 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:50.209120 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:50.210195 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:50.210199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:50.211623 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:50.211636 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:50.212530 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:50.212539 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:50.212800 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:50.213587 (+ 787us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:38:50.213590 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:50.213630 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:38:50.213711 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:50.214087 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:50.214101 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:50.214110 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 08:38:50.214309 (+ 199us) client_negotiation.cc:240] Negotiation successful
0808 08:38:50.214705 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":266,"threads_started":1}
I20260808 08:38:50.217443 26303 heartbeater.cc:347] Connected to a master server at 127.5.164.254:37903
I20260808 08:38:50.217764 26303 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:50.218598 26303 heartbeater.cc:511] Master 127.5.164.254:37903 requested a full tablet report, sending...
I20260808 08:38:50.221019 26100 ts_manager.cc:194] Registered new tserver with Master: 094bcd195a4c4b449b9e5cb857a6fbdc (127.5.164.193:35701)
I20260808 08:38:50.223186 26100 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.164.193:33287
W20260808 08:38:50.555691 26307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:50.556013 26307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:50.556183 26307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:50.563516 26307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:50.563661 26307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:50.563839 26307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:38:50.573220 26307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:35475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37903
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:50.574530 26307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:50.576462 26307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:50.589570 26312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:50.589618 26315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:50.589666 26313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:50.590934 26307 server_base.cc:1034] running on GCE node
I20260808 08:38:50.591581 26307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:50.592509 26307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:50.593719 26307 hybrid_clock.cc:648] HybridClock initialized: now 1786178330593654 us; error 56 us; skew 500 ppm
I20260808 08:38:50.594033 26307 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:38:50.596284 26307 webserver.cc:460] Webserver started at http://127.5.164.194:43517/ using document root <none> and password file <none>
I20260808 08:38:50.596979 26307 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:50.597095 26307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:50.597422 26307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:50.600396 26307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "55c6d36017a4417b8b018ade810c633a"
format_stamp: "Formatted at 2026-08-08 08:38:50 on dist-test-slave-chsk"
server_key: "a950948802d2fc754ca43f267a13418b"
server_key_iv: "df520e0a9afee42a396b02d1cb652a6c"
server_key_version: "encryptionkey@0"
I20260808 08:38:50.601197 26307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "55c6d36017a4417b8b018ade810c633a"
format_stamp: "Formatted at 2026-08-08 08:38:50 on dist-test-slave-chsk"
server_key: "a950948802d2fc754ca43f267a13418b"
server_key_iv: "df520e0a9afee42a396b02d1cb652a6c"
server_key_version: "encryptionkey@0"
I20260808 08:38:50.606153 26307 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 08:38:50.609548 26322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:50.610816 26307 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:38:50.610981 26307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "55c6d36017a4417b8b018ade810c633a"
format_stamp: "Formatted at 2026-08-08 08:38:50 on dist-test-slave-chsk"
server_key: "a950948802d2fc754ca43f267a13418b"
server_key_iv: "df520e0a9afee42a396b02d1cb652a6c"
server_key_version: "encryptionkey@0"
I20260808 08:38:50.611275 26307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:50.626463 26307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:50.627346 26307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:50.627665 26307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:50.628640 26307 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:50.630489 26307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:50.630616 26307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:50.630735 26307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:50.630812 26307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:50.668453 26307 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:38761
I20260808 08:38:50.668493 26443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:38761 every 8 connection(s)
I20260808 08:38:50.669826 26307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:38:50.678704 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 26307
I20260808 08:38:50.678895 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:38:50.679579 5779 external_mini_cluster.cc:1428] Setting key 837abea228f8d65f668e150c50396ba1
I20260808 08:38:50.682942 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37903
--builtin_ntp_servers=127.5.164.212:35475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:38:50.683698 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:50.672673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:58887 (local address 127.5.164.254:37903)
0808 08:38:50.672891 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:50.672897 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:50.674255 (+ 1358us) server_negotiation.cc:407] Connection header received
0808 08:38:50.676234 (+ 1979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:50.676239 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:50.676343 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:50.676428 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:50.677554 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:50.678293 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:50.680522 (+ 2229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:50.681212 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:50.681353 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:50.682919 (+ 1566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:50.682924 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:50.682927 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:50.682945 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:50.682977 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:50.682988 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:50.683103 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:50.683381 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 08:38:50.683466 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":72}
I20260808 08:38:50.685250 26446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:50.673238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37903 (local address 127.5.164.194:58887)
0808 08:38:50.674105 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:50.674141 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:50.675954 (+ 1813us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:50.676672 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:50.676680 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:50.676762 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:50.677406 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:50.677424 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:50.678442 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:50.678448 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:50.680356 (+ 1908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:50.680368 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:50.681455 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:50.681463 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:50.681743 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:50.682562 (+ 819us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:38:50.682566 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:50.682631 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:38:50.682738 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:50.683125 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:50.683160 (+ 35us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:50.683170 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 08:38:50.683360 (+ 190us) client_negotiation.cc:240] Negotiation successful
0808 08:38:50.683786 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":279,"threads_started":1}
I20260808 08:38:50.686699 26444 heartbeater.cc:347] Connected to a master server at 127.5.164.254:37903
I20260808 08:38:50.687039 26444 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:50.687841 26444 heartbeater.cc:511] Master 127.5.164.254:37903 requested a full tablet report, sending...
I20260808 08:38:50.689389 26100 ts_manager.cc:194] Registered new tserver with Master: 55c6d36017a4417b8b018ade810c633a (127.5.164.194:38761)
I20260808 08:38:50.690598 26100 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.164.194:58887
W20260808 08:38:51.023698 26447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:51.023980 26447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:51.024075 26447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:51.031294 26447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:51.031407 26447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:51.031517 26447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:38:51.040617 26447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:35475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:37903
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:51.041887 26447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:51.043757 26447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:51.056735 26454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:51.056806 26456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:51.056833 26453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:51.057508 26447 server_base.cc:1034] running on GCE node
I20260808 08:38:51.058089 26447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:51.059016 26447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:51.060288 26447 hybrid_clock.cc:648] HybridClock initialized: now 1786178331060207 us; error 59 us; skew 500 ppm
I20260808 08:38:51.060664 26447 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:38:51.063290 26447 webserver.cc:460] Webserver started at http://127.5.164.195:43041/ using document root <none> and password file <none>
I20260808 08:38:51.063987 26447 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:51.064112 26447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:51.064459 26447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:51.067286 26447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "c2ee43ee611040ae8eeea3390a630ba3"
format_stamp: "Formatted at 2026-08-08 08:38:51 on dist-test-slave-chsk"
server_key: "246158e6bb45e5a76544029271a90c44"
server_key_iv: "cbe35a9438afbd56b16e9b585035ac1b"
server_key_version: "encryptionkey@0"
I20260808 08:38:51.068079 26447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "c2ee43ee611040ae8eeea3390a630ba3"
format_stamp: "Formatted at 2026-08-08 08:38:51 on dist-test-slave-chsk"
server_key: "246158e6bb45e5a76544029271a90c44"
server_key_iv: "cbe35a9438afbd56b16e9b585035ac1b"
server_key_version: "encryptionkey@0"
I20260808 08:38:51.073123 26447 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 08:38:51.076658 26462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:51.078049 26447 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260808 08:38:51.078239 26447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "c2ee43ee611040ae8eeea3390a630ba3"
format_stamp: "Formatted at 2026-08-08 08:38:51 on dist-test-slave-chsk"
server_key: "246158e6bb45e5a76544029271a90c44"
server_key_iv: "cbe35a9438afbd56b16e9b585035ac1b"
server_key_version: "encryptionkey@0"
I20260808 08:38:51.078473 26447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:51.096721 26447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:51.097590 26447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:51.097918 26447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:51.098915 26447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:51.100447 26447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:51.100575 26447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:51.100714 26447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:51.100804 26447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:51.134883 26447 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:40253
I20260808 08:38:51.134975 26583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:40253 every 8 connection(s)
I20260808 08:38:51.136401 26447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:38:51.137377 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 26447
I20260808 08:38:51.137569 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:38:51.138031 5779 external_mini_cluster.cc:1428] Setting key 0e4b72cc916fcf8d4f6e28b85b83266e
I20260808 08:38:51.148957 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.139042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:56039 (local address 127.5.164.254:37903)
0808 08:38:51.139264 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:51.139272 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:51.140946 (+ 1674us) server_negotiation.cc:407] Connection header received
0808 08:38:51.142863 (+ 1917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:51.142867 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:51.142934 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:51.143019 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:51.144104 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.144945 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.146457 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.146852 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.146945 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.148286 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:51.148291 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:51.148294 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:51.148311 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:51.148344 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:51.148356 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:51.148426 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:51.148642 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 08:38:51.148717 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:38:51.149930 26586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.139769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:37903 (local address 127.5.164.195:56039)
0808 08:38:51.140773 (+ 1004us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:51.140845 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:51.142604 (+ 1759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:51.143285 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:51.143292 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:51.143373 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:51.143960 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:51.143976 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.145079 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.145082 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:51.146308 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:51.146320 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.147038 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.147042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:51.147303 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.147980 (+ 677us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:38:51.147984 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:51.148035 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:38:51.148108 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:51.148448 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:51.148456 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:51.148461 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 08:38:51.148598 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 08:38:51.148883 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":343,"threads_started":1}
I20260808 08:38:51.151325 26584 heartbeater.cc:347] Connected to a master server at 127.5.164.254:37903
I20260808 08:38:51.151645 26584 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:51.152472 26584 heartbeater.cc:511] Master 127.5.164.254:37903 requested a full tablet report, sending...
I20260808 08:38:51.153848 26100 ts_manager.cc:194] Registered new tserver with Master: c2ee43ee611040ae8eeea3390a630ba3 (127.5.164.195:40253)
I20260808 08:38:51.154672 26100 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.164.195:56039
I20260808 08:38:51.165699 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:38:51.175815 26305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.169782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34996 (local address 127.5.164.254:37903)
0808 08:38:51.170012 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:51.170021 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:51.170428 (+ 407us) server_negotiation.cc:407] Connection header received
0808 08:38:51.170562 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:51.170566 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:51.170642 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:51.170727 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:51.171244 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.172051 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.173424 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.173883 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.173987 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.175056 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:51.175060 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:51.175063 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:51.175080 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:51.175112 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:51.175124 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:51.175313 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:51.175471 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 08:38:51.175574 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:38:51.179668 26100 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34996:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:38:51.186909 26100 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:38:51.213629 26601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.199647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35158 (local address 127.5.164.193:35701)
0808 08:38:51.200497 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:51.200508 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:51.201806 (+ 1298us) server_negotiation.cc:407] Connection header received
0808 08:38:51.202127 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:51.202138 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:51.202355 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:51.202527 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:51.203920 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.205608 (+ 1688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.209133 (+ 3525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.210601 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.210742 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.212321 (+ 1579us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:51.213022 (+ 701us) server_negotiation.cc:299] Negotiation successful
0808 08:38:51.213209 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":460,"threads_started":1}
I20260808 08:38:51.214429 26599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.199000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48630 (local address 127.5.164.194:38761)
0808 08:38:51.199797 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:51.199807 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:51.201236 (+ 1429us) server_negotiation.cc:407] Connection header received
0808 08:38:51.201715 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:51.201725 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:51.202018 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:51.202194 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:51.203877 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.205604 (+ 1727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.210824 (+ 5220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.212841 (+ 2017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.212969 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.213204 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:51.213909 (+ 705us) server_negotiation.cc:299] Negotiation successful
0808 08:38:51.214081 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":815,"threads_started":1}
I20260808 08:38:51.214488 26600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.199097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:35701 (local address 127.0.0.1:35158)
0808 08:38:51.201702 (+ 2605us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:51.201720 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:51.201905 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:51.202840 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:51.202847 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:51.202878 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:51.203479 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:51.203506 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.205804 (+ 2298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.205811 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:51.208881 (+ 3070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:51.208897 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.212521 (+ 3624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.212528 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:51.212740 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.212801 (+ 61us) client_negotiation.cc:769] Sending connection context
0808 08:38:51.213854 (+ 1053us) client_negotiation.cc:240] Negotiation successful
0808 08:38:51.214053 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2447,"mutex_wait_us":3,"thread_start_us":2296,"threads_started":1}
I20260808 08:38:51.215400 26598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.198730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:38761 (local address 127.0.0.1:48630)
0808 08:38:51.201081 (+ 2351us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:51.201131 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:51.201412 (+ 281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:51.202519 (+ 1107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:51.202526 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:51.202556 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:51.203731 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:51.203745 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.208452 (+ 4707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.208458 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:51.210597 (+ 2139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:51.210612 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.213383 (+ 2771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.213390 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:51.213560 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.213601 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 08:38:51.214903 (+ 1302us) client_negotiation.cc:240] Negotiation successful
0808 08:38:51.215053 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2123,"mutex_wait_us":740,"thread_start_us":1966,"threads_started":1}
I20260808 08:38:51.218532 26232 tablet_service.cc:1467] Processing CreateTablet for tablet 0e1c3afabcb54d70830bf8fd3ecde2c3 (DEFAULT_TABLE table=test-table [id=d219ca2783114edd9fd3aecec31a7b4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:51.218924 26375 tablet_service.cc:1467] Processing CreateTablet for tablet 0e1c3afabcb54d70830bf8fd3ecde2c3 (DEFAULT_TABLE table=test-table [id=d219ca2783114edd9fd3aecec31a7b4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:51.220121 26375 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e1c3afabcb54d70830bf8fd3ecde2c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:51.220145 26232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e1c3afabcb54d70830bf8fd3ecde2c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:51.223523 26602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.201820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:40253 (local address 127.0.0.1:54564)
0808 08:38:51.214763 (+ 12943us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:51.214782 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:51.214915 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:51.215773 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:51.215778 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:51.215808 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:51.216136 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:51.216148 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.218392 (+ 2244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.218397 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:51.220398 (+ 2001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:51.220418 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.222673 (+ 2255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.222686 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:51.222893 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.222936 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 08:38:51.223068 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 08:38:51.223219 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12780,"thread_start_us":12529,"threads_started":1}
I20260808 08:38:51.224365 26603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.202432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54564 (local address 127.5.164.195:40253)
0808 08:38:51.213965 (+ 11533us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:51.213975 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:51.214986 (+ 1011us) server_negotiation.cc:407] Connection header received
0808 08:38:51.215103 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:51.215109 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:51.215366 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:51.215569 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:51.216665 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.218221 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.220608 (+ 2387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.222033 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.222175 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.222441 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:51.223810 (+ 1369us) server_negotiation.cc:299] Negotiation successful
0808 08:38:51.223979 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11366,"thread_start_us":11201,"threads_started":1}
I20260808 08:38:51.226070 26303 heartbeater.cc:503] Master 127.5.164.254:37903 was elected leader, sending a full tablet report...
I20260808 08:38:51.228150 26516 tablet_service.cc:1467] Processing CreateTablet for tablet 0e1c3afabcb54d70830bf8fd3ecde2c3 (DEFAULT_TABLE table=test-table [id=d219ca2783114edd9fd3aecec31a7b4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:51.229691 26516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e1c3afabcb54d70830bf8fd3ecde2c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:51.233484 26604 tablet_bootstrap.cc:492] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a: Bootstrap starting.
I20260808 08:38:51.235548 26605 tablet_bootstrap.cc:492] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc: Bootstrap starting.
I20260808 08:38:51.237531 26604 tablet_bootstrap.cc:654] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:51.239084 26605 tablet_bootstrap.cc:654] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:51.239604 26604 log.cc:824] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:51.240427 26605 log.cc:824] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:51.243314 26609 tablet_bootstrap.cc:492] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3: Bootstrap starting.
I20260808 08:38:51.243405 26604 tablet_bootstrap.cc:492] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a: No bootstrap required, opened a new log
I20260808 08:38:51.243777 26604 ts_tablet_manager.cc:1397] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.006s
I20260808 08:38:51.246600 26605 tablet_bootstrap.cc:492] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc: No bootstrap required, opened a new log
I20260808 08:38:51.246826 26609 tablet_bootstrap.cc:654] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:51.246910 26605 ts_tablet_manager.cc:1397] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260808 08:38:51.248078 26609 log.cc:824] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:51.251529 26609 tablet_bootstrap.cc:492] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3: No bootstrap required, opened a new log
I20260808 08:38:51.251804 26609 ts_tablet_manager.cc:1397] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260808 08:38:51.255867 26604 raft_consensus.cc:348] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c6d36017a4417b8b018ade810c633a" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38761 } } peers { permanent_uuid: "094bcd195a4c4b449b9e5cb857a6fbdc" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 35701 } } peers { permanent_uuid: "c2ee43ee611040ae8eeea3390a630ba3" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40253 } }
I20260808 08:38:51.256359 26604 raft_consensus.cc:374] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:51.256470 26604 raft_consensus.cc:729] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55c6d36017a4417b8b018ade810c633a, State: Initialized, Role: FOLLOWER
I20260808 08:38:51.257115 26604 consensus_queue.cc:260] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c6d36017a4417b8b018ade810c633a" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38761 } } peers { permanent_uuid: "094bcd195a4c4b449b9e5cb857a6fbdc" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 35701 } } peers { permanent_uuid: "c2ee43ee611040ae8eeea3390a630ba3" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40253 } }
I20260808 08:38:51.257771 26605 raft_consensus.cc:348] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c6d36017a4417b8b018ade810c633a" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38761 } } peers { permanent_uuid: "094bcd195a4c4b449b9e5cb857a6fbdc" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 35701 } } peers { permanent_uuid: "c2ee43ee611040ae8eeea3390a630ba3" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40253 } }
I20260808 08:38:51.258234 26605 raft_consensus.cc:374] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:51.258330 26605 raft_consensus.cc:729] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 094bcd195a4c4b449b9e5cb857a6fbdc, State: Initialized, Role: FOLLOWER
I20260808 08:38:51.258433 26444 heartbeater.cc:503] Master 127.5.164.254:37903 was elected leader, sending a full tablet report...
I20260808 08:38:51.259128 26604 ts_tablet_manager.cc:1428] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a: Time spent starting tablet: real 0.015s user 0.010s sys 0.003s
I20260808 08:38:51.259025 26605 consensus_queue.cc:260] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c6d36017a4417b8b018ade810c633a" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38761 } } peers { permanent_uuid: "094bcd195a4c4b449b9e5cb857a6fbdc" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 35701 } } peers { permanent_uuid: "c2ee43ee611040ae8eeea3390a630ba3" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40253 } }
I20260808 08:38:51.259531 26609 raft_consensus.cc:348] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c6d36017a4417b8b018ade810c633a" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38761 } } peers { permanent_uuid: "094bcd195a4c4b449b9e5cb857a6fbdc" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 35701 } } peers { permanent_uuid: "c2ee43ee611040ae8eeea3390a630ba3" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40253 } }
I20260808 08:38:51.259933 26609 raft_consensus.cc:374] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:51.260052 26609 raft_consensus.cc:729] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2ee43ee611040ae8eeea3390a630ba3, State: Initialized, Role: FOLLOWER
I20260808 08:38:51.260593 26609 consensus_queue.cc:260] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c6d36017a4417b8b018ade810c633a" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38761 } } peers { permanent_uuid: "094bcd195a4c4b449b9e5cb857a6fbdc" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 35701 } } peers { permanent_uuid: "c2ee43ee611040ae8eeea3390a630ba3" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40253 } }
I20260808 08:38:51.261632 26584 heartbeater.cc:503] Master 127.5.164.254:37903 was elected leader, sending a full tablet report...
I20260808 08:38:51.262261 26609 ts_tablet_manager.cc:1428] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3: Time spent starting tablet: real 0.010s user 0.009s sys 0.001s
I20260808 08:38:51.263971 26605 ts_tablet_manager.cc:1428] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc: Time spent starting tablet: real 0.017s user 0.014s sys 0.005s
I20260808 08:38:51.343354 26613 raft_consensus.cc:482] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:38:51.343683 26613 raft_consensus.cc:504] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c6d36017a4417b8b018ade810c633a" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38761 } } peers { permanent_uuid: "094bcd195a4c4b449b9e5cb857a6fbdc" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 35701 } } peers { permanent_uuid: "c2ee43ee611040ae8eeea3390a630ba3" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40253 } }
I20260808 08:38:51.345417 26613 leader_election.cc:288] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55c6d36017a4417b8b018ade810c633a (127.5.164.194:38761), c2ee43ee611040ae8eeea3390a630ba3 (127.5.164.195:40253)
I20260808 08:38:51.352160 26599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.345754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:37111 (local address 127.5.164.194:38761)
0808 08:38:51.345995 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:51.346002 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:51.346433 (+ 431us) server_negotiation.cc:407] Connection header received
0808 08:38:51.346818 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:51.346824 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:51.346908 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:51.347008 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:51.347796 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.348483 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.350326 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.351071 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.351274 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.351328 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:51.351761 (+ 433us) server_negotiation.cc:299] Negotiation successful
0808 08:38:51.351884 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:38:51.352231 26603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.346267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:55873 (local address 127.5.164.195:40253)
0808 08:38:51.346495 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:51.346502 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:51.346632 (+ 130us) server_negotiation.cc:407] Connection header received
0808 08:38:51.346857 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:51.346861 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:51.346919 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:51.347019 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:51.347764 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.348691 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.350478 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.351317 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.351500 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.351565 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:51.351856 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 08:38:51.351986 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 08:38:51.352283 26615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.345628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:38761 (local address 127.5.164.193:37111)
0808 08:38:51.346316 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:51.346337 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:51.346577 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:51.347025 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:51.347029 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:51.347053 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:51.347655 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:51.347665 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.348613 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.348620 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:51.350136 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:51.350149 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.351473 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.351477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:51.351594 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.351617 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:38:51.351732 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 08:38:51.351860 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"mutex_wait_us":23,"thread_start_us":316,"threads_started":1}
I20260808 08:38:51.352358 26616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.345712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:40253 (local address 127.5.164.193:55873)
0808 08:38:51.346512 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:51.346542 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:51.346703 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:51.347045 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:51.347049 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:51.347073 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:51.347597 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:51.347607 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.348834 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.348842 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:51.350299 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:51.350309 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.351523 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.351529 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:51.351702 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.351725 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 08:38:51.351827 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 08:38:51.351949 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":672,"mutex_wait_us":15,"thread_start_us":760,"threads_started":1}
I20260808 08:38:51.353370 26395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e1c3afabcb54d70830bf8fd3ecde2c3" candidate_uuid: "094bcd195a4c4b449b9e5cb857a6fbdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c6d36017a4417b8b018ade810c633a" is_pre_election: true
I20260808 08:38:51.353852 26537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e1c3afabcb54d70830bf8fd3ecde2c3" candidate_uuid: "094bcd195a4c4b449b9e5cb857a6fbdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ee43ee611040ae8eeea3390a630ba3" is_pre_election: true
I20260808 08:38:51.354070 26395 raft_consensus.cc:2454] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 094bcd195a4c4b449b9e5cb857a6fbdc in term 0.
I20260808 08:38:51.354460 26537 raft_consensus.cc:2454] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 094bcd195a4c4b449b9e5cb857a6fbdc in term 0.
I20260808 08:38:51.354852 26182 leader_election.cc:302] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 094bcd195a4c4b449b9e5cb857a6fbdc, 55c6d36017a4417b8b018ade810c633a; no voters:
I20260808 08:38:51.355391 26613 raft_consensus.cc:2781] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:38:51.355568 26613 raft_consensus.cc:482] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:38:51.355674 26613 raft_consensus.cc:3037] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:51.357828 26613 raft_consensus.cc:504] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c6d36017a4417b8b018ade810c633a" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38761 } } peers { permanent_uuid: "094bcd195a4c4b449b9e5cb857a6fbdc" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 35701 } } peers { permanent_uuid: "c2ee43ee611040ae8eeea3390a630ba3" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40253 } }
I20260808 08:38:51.358448 26613 leader_election.cc:288] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [CANDIDATE]: Term 1 election: Requested vote from peers 55c6d36017a4417b8b018ade810c633a (127.5.164.194:38761), c2ee43ee611040ae8eeea3390a630ba3 (127.5.164.195:40253)
I20260808 08:38:51.358973 26537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e1c3afabcb54d70830bf8fd3ecde2c3" candidate_uuid: "094bcd195a4c4b449b9e5cb857a6fbdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2ee43ee611040ae8eeea3390a630ba3"
I20260808 08:38:51.358973 26395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e1c3afabcb54d70830bf8fd3ecde2c3" candidate_uuid: "094bcd195a4c4b449b9e5cb857a6fbdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55c6d36017a4417b8b018ade810c633a"
I20260808 08:38:51.359220 26395 raft_consensus.cc:3037] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:51.359227 26537 raft_consensus.cc:3037] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:51.362573 26537 raft_consensus.cc:2454] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 094bcd195a4c4b449b9e5cb857a6fbdc in term 1.
I20260808 08:38:51.362573 26395 raft_consensus.cc:2454] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 094bcd195a4c4b449b9e5cb857a6fbdc in term 1.
I20260808 08:38:51.363047 26181 leader_election.cc:302] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 094bcd195a4c4b449b9e5cb857a6fbdc, 55c6d36017a4417b8b018ade810c633a, c2ee43ee611040ae8eeea3390a630ba3; no voters:
I20260808 08:38:51.363430 26613 raft_consensus.cc:2781] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:38:51.363869 26613 raft_consensus.cc:686] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [term 1 LEADER]: Becoming Leader. State: Replica: 094bcd195a4c4b449b9e5cb857a6fbdc, State: Running, Role: LEADER
I20260808 08:38:51.364331 26613 consensus_queue.cc:237] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c6d36017a4417b8b018ade810c633a" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38761 } } peers { permanent_uuid: "094bcd195a4c4b449b9e5cb857a6fbdc" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 35701 } } peers { permanent_uuid: "c2ee43ee611040ae8eeea3390a630ba3" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40253 } }
I20260808 08:38:51.368919 26100 catalog_manager.cc:5495] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc reported cstate change: term changed from 0 to 1, leader changed from <none> to 094bcd195a4c4b449b9e5cb857a6fbdc (127.5.164.193). New cstate: current_term: 1 leader_uuid: "094bcd195a4c4b449b9e5cb857a6fbdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55c6d36017a4417b8b018ade810c633a" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "094bcd195a4c4b449b9e5cb857a6fbdc" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 35701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2ee43ee611040ae8eeea3390a630ba3" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40253 } health_report { overall_health: UNKNOWN } } }
W20260808 08:38:51.388187 26585 tablet.cc:2369] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:38:51.405308 26601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.399314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35162 (local address 127.5.164.193:35701)
0808 08:38:51.399547 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:51.399556 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:51.399717 (+ 161us) server_negotiation.cc:407] Connection header received
0808 08:38:51.399971 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:51.399976 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:51.400100 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:51.400254 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:38:51.400606 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.401322 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.403126 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.403616 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.403725 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.404206 (+ 481us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:38:51.404704 (+ 498us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:38:51.404832 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:51.404941 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 08:38:51.404978 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:38:51.413617 26395 raft_consensus.cc:1261] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a [term 1 FOLLOWER]: Refusing update from remote peer 094bcd195a4c4b449b9e5cb857a6fbdc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:38:51.413617 26537 raft_consensus.cc:1261] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3 [term 1 FOLLOWER]: Refusing update from remote peer 094bcd195a4c4b449b9e5cb857a6fbdc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:38:51.414723 26618 consensus_queue.cc:1035] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2ee43ee611040ae8eeea3390a630ba3" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:38:51.415100 26613 consensus_queue.cc:1035] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "55c6d36017a4417b8b018ade810c633a" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 38761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 08:38:51.421927 26445 tablet.cc:2369] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:38:51.440810 26100 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:38:51.441155 26100 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34996:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:38:51.444869 26100 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 811e59abdb0848bda0a390ea39b4d80a: Sending DeleteTablet for 3 replicas of tablet 0e1c3afabcb54d70830bf8fd3ecde2c3
I20260808 08:38:51.446108 26375 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e1c3afabcb54d70830bf8fd3ecde2c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:51 UTC) from {username='slave'} at 127.0.0.1:48630
I20260808 08:38:51.446292 26516 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e1c3afabcb54d70830bf8fd3ecde2c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:51 UTC) from {username='slave'} at 127.0.0.1:54564
I20260808 08:38:51.447449 26631 tablet_replica.cc:330] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a: stopping tablet replica
I20260808 08:38:51.447459 26232 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e1c3afabcb54d70830bf8fd3ecde2c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:51 UTC) from {username='slave'} at 127.0.0.1:35158
I20260808 08:38:51.448288 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 26164
I20260808 08:38:51.447912 26631 raft_consensus.cc:2229] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:38:51.448879 26631 raft_consensus.cc:2258] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:38:51.457890 26632 tablet_replica.cc:330] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3: stopping tablet replica
I20260808 08:38:51.458534 26632 raft_consensus.cc:2229] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:38:51.459100 26632 raft_consensus.cc:2258] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:38:51.460894 26631 ts_tablet_manager.cc:1905] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:38:51.461130 26601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.450315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35166 (local address 127.5.164.193:35701)
0808 08:38:51.450523 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:51.450529 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:51.450984 (+ 455us) server_negotiation.cc:407] Connection header received
0808 08:38:51.451309 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:51.451318 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:51.451453 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:51.451536 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:51.452391 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.453971 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.456415 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.457148 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.457285 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.459207 (+ 1922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:51.459222 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:51.459244 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:51.460064 (+ 820us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:51.460129 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:51.460154 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:51.460244 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:51.460562 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 08:38:51.460706 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:38:51.461429 26632 ts_tablet_manager.cc:1905] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:38:51.462846 26297 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:51.466900 26632 ts_tablet_manager.cc:1918] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:51.467103 26632 log.cc:1196] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/0e1c3afabcb54d70830bf8fd3ecde2c3
I20260808 08:38:51.467820 26632 ts_tablet_manager.cc:1939] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P c2ee43ee611040ae8eeea3390a630ba3: Deleting consensus metadata
I20260808 08:38:51.470301 26083 catalog_manager.cc:4841] TS c2ee43ee611040ae8eeea3390a630ba3 (127.5.164.195:40253): tablet 0e1c3afabcb54d70830bf8fd3ecde2c3 (table test-table [id=d219ca2783114edd9fd3aecec31a7b4f]) successfully deleted
I20260808 08:38:51.472481 26631 ts_tablet_manager.cc:1918] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:51.472743 26631 log.cc:1196] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/0e1c3afabcb54d70830bf8fd3ecde2c3
I20260808 08:38:51.473483 26631 ts_tablet_manager.cc:1939] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 55c6d36017a4417b8b018ade810c633a: Deleting consensus metadata
I20260808 08:38:51.475646 26084 catalog_manager.cc:4841] TS 55c6d36017a4417b8b018ade810c633a (127.5.164.194:38761): tablet 0e1c3afabcb54d70830bf8fd3ecde2c3 (table test-table [id=d219ca2783114edd9fd3aecec31a7b4f]) successfully deleted
I20260808 08:38:51.569741 26633 tablet_replica.cc:330] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc: stopping tablet replica
I20260808 08:38:51.570356 26633 raft_consensus.cc:2229] T 0e1c3afabcb54d70830bf8fd3ecde2c3 P 094bcd195a4c4b449b9e5cb857a6fbdc [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:38:51.570734 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 26164
I20260808 08:38:51.592808 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 26307
W20260808 08:38:51.592751 26083 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.164.193:35701 (error 108)
I20260808 08:38:51.594779 26602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.594282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:35701 (local address 127.0.0.1:35178)
0808 08:38:51.594477 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:51.594618 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:35701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 08:38:51.595124 26083 catalog_manager.cc:4584] TS 094bcd195a4c4b449b9e5cb857a6fbdc (127.5.164.193:35701): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0e1c3afabcb54d70830bf8fd3ecde2c3: Network error: Client connection negotiation failed: client connection to 127.5.164.193:35701: connect: Connection refused (error 111)
I20260808 08:38:51.600039 26599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.593953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48642 (local address 127.5.164.194:38761)
0808 08:38:51.594173 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:51.594178 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:51.594195 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:38:51.594250 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:51.594254 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:51.594362 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:51.594481 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:51.594887 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.595890 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.597131 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.597530 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.597623 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.598602 (+ 979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:51.598610 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:51.598624 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:51.599303 (+ 679us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:51.599351 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:51.599371 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:51.599466 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:51.599574 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 08:38:51.599669 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:38:51.600749 26439 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:51.648788 26602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.648221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:35701 (local address 127.0.0.1:35182)
0808 08:38:51.648446 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:51.648573 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:35701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 08:38:51.649874 26602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.649493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:35701 (local address 127.0.0.1:35190)
0808 08:38:51.649670 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:51.649737 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:35701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 08:38:51.705241 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 26307
I20260808 08:38:51.710623 26602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.710009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:35701 (local address 127.0.0.1:35198)
0808 08:38:51.710271 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:51.710396 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:35701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 08:38:51.711805 26602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.711361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:35701 (local address 127.0.0.1:35210)
0808 08:38:51.711539 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:51.711643 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:35701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 08:38:51.725957 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 26447
I20260808 08:38:51.739907 26603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.726833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54566 (local address 127.5.164.195:40253)
0808 08:38:51.727010 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:51.727015 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:51.727034 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:38:51.727228 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:51.727232 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:51.727320 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:51.727407 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:51.727834 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.728689 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.730856 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:51.731377 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:51.731470 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:51.737894 (+ 6424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:51.737910 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:51.737933 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:51.738876 (+ 943us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:51.738951 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:51.738982 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:51.739113 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:51.739390 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 08:38:51.739522 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:38:51.740753 26579 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:51.792572 26602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.792029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:35701 (local address 127.0.0.1:35214)
0808 08:38:51.792315 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:51.792414 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:35701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
I20260808 08:38:51.793641 26602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.793258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:35701 (local address 127.0.0.1:35230)
0808 08:38:51.793448 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:51.793532 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:35701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260808 08:38:51.832571 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 26447
I20260808 08:38:51.852885 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 26066
I20260808 08:38:51.854086 26132 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:51.966897 26602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:51.965761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:35701 (local address 127.0.0.1:35244)
0808 08:38:51.966565 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:51.966691 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:35701: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260}
I20260808 08:38:51.966935 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 26066
2026-08-08T08:38:51Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2894 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:38:52 dist-test-slave-chsk krb5kdc[26644](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:38:52 dist-test-slave-chsk krb5kdc[26644](info): set up 2 sockets
Aug 08 08:38:52 dist-test-slave-chsk krb5kdc[26644](info): commencing operation
krb5kdc: starting...
W20260808 08:38:53.143613 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.006s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:38:53 dist-test-slave-chsk krb5kdc[26644](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:38:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:38:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:38:53.470191 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:46155
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:35139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:46155
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:38:53.814456 26657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:53.814735 26657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:53.814915 26657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:53.822098 26657 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:38:53.822211 26657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:53.822302 26657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:53.822389 26657 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:38:53.822499 26657 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:38:53.832288 26657 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:35139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:46155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:46155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:53.833645 26657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:53.834977 26657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:53.846798 26663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:53.846751 26664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:53.846721 26666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:53.847853 26657 server_base.cc:1034] running on GCE node
I20260808 08:38:53.848639 26657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:53.850003 26657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:53.851260 26657 hybrid_clock.cc:648] HybridClock initialized: now 1786178333851216 us; error 34 us; skew 500 ppm
I20260808 08:38:53.851619 26657 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:38:53 dist-test-slave-chsk krb5kdc[26644](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178333, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:38:53.854687 26657 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:38:53.856288 26657 webserver.cc:460] Webserver started at http://127.5.164.254:34351/ using document root <none> and password file <none>
I20260808 08:38:53.856963 26657 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:53.857115 26657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:53.857426 26657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:53.860450 26657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "478f55412e8b4eb5b7c9ad725576dffd"
format_stamp: "Formatted at 2026-08-08 08:38:53 on dist-test-slave-chsk"
server_key: "dddfe7af623c9a3c4eb41d728edb328a"
server_key_iv: "34480d2f370db37c962db69ca4a11e09"
server_key_version: "encryptionkey@0"
I20260808 08:38:53.861215 26657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "478f55412e8b4eb5b7c9ad725576dffd"
format_stamp: "Formatted at 2026-08-08 08:38:53 on dist-test-slave-chsk"
server_key: "dddfe7af623c9a3c4eb41d728edb328a"
server_key_iv: "34480d2f370db37c962db69ca4a11e09"
server_key_version: "encryptionkey@0"
I20260808 08:38:53.866214 26657 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:38:53.869604 26673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:53.870848 26657 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:38:53.871037 26657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "478f55412e8b4eb5b7c9ad725576dffd"
format_stamp: "Formatted at 2026-08-08 08:38:53 on dist-test-slave-chsk"
server_key: "dddfe7af623c9a3c4eb41d728edb328a"
server_key_iv: "34480d2f370db37c962db69ca4a11e09"
server_key_version: "encryptionkey@0"
I20260808 08:38:53.871285 26657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:53.906684 26657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:53.910679 26657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:53.910975 26657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:53.930176 26657 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:46155
I20260808 08:38:53.930208 26725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:46155 every 8 connection(s)
I20260808 08:38:53.931586 26657 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:38:53.932263 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 26657
I20260808 08:38:53.932456 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:38:53.933032 5779 external_mini_cluster.cc:1428] Setting key f7f5cd854816b016649e3758a4f118a0
I20260808 08:38:53.935942 26726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:38:53 dist-test-slave-chsk krb5kdc[26644](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:38:53.947769 26726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd: Bootstrap starting.
I20260808 08:38:53.950805 26726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:53.951922 26726 log.cc:824] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:53.955281 26726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd: No bootstrap required, opened a new log
I20260808 08:38:53.956700 26729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:53.934884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34390 (local address 127.5.164.254:46155)
0808 08:38:53.935650 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:53.935662 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:53.935708 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:38:53.937768 (+ 2060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:53.937797 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:53.938290 (+ 493us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:53.938753 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:53.940996 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:53.942356 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:53.943741 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:53.944449 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:53.944659 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:53.948806 (+ 4147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:53.948814 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:53.948826 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:53.948868 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:53.952045 (+ 3177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:53.952953 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:53.952959 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:53.952967 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:53.953128 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:53.953554 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:53.953559 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:53.953562 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:53.954244 (+ 682us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:53.954526 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:53.954911 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 08:38:53.955386 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":354,"threads_started":1}
I20260808 08:38:53.963829 26726 raft_consensus.cc:348] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "478f55412e8b4eb5b7c9ad725576dffd" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46155 } }
I20260808 08:38:53.964133 26726 raft_consensus.cc:374] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:53.964216 26726 raft_consensus.cc:729] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 478f55412e8b4eb5b7c9ad725576dffd, State: Initialized, Role: FOLLOWER
I20260808 08:38:53.964731 26726 consensus_queue.cc:260] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "478f55412e8b4eb5b7c9ad725576dffd" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46155 } }
I20260808 08:38:53.964931 26726 raft_consensus.cc:388] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:38:53.965088 26726 raft_consensus.cc:482] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:38:53.965294 26726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:53.967701 26726 raft_consensus.cc:504] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "478f55412e8b4eb5b7c9ad725576dffd" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46155 } }
I20260808 08:38:53.968205 26726 leader_election.cc:302] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 478f55412e8b4eb5b7c9ad725576dffd; no voters:
I20260808 08:38:53.968802 26726 leader_election.cc:288] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:38:53.968931 26731 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:38:53.970418 26731 raft_consensus.cc:686] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [term 1 LEADER]: Becoming Leader. State: Replica: 478f55412e8b4eb5b7c9ad725576dffd, State: Running, Role: LEADER
I20260808 08:38:53.970901 26731 consensus_queue.cc:237] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "478f55412e8b4eb5b7c9ad725576dffd" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46155 } }
I20260808 08:38:53.971199 26726 sys_catalog.cc:564] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:38:53.974174 26733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 478f55412e8b4eb5b7c9ad725576dffd. Latest consensus state: current_term: 1 leader_uuid: "478f55412e8b4eb5b7c9ad725576dffd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "478f55412e8b4eb5b7c9ad725576dffd" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46155 } } }
I20260808 08:38:53.974146 26732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "478f55412e8b4eb5b7c9ad725576dffd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "478f55412e8b4eb5b7c9ad725576dffd" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46155 } } }
I20260808 08:38:53.974566 26733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [sys.catalog]: This master's current role is: LEADER
I20260808 08:38:53.974581 26732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd [sys.catalog]: This master's current role is: LEADER
I20260808 08:38:53.977522 26739 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:38:53.981835 26739 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:38:53.990125 26739 catalog_manager.cc:1347] Generated new cluster ID: bf67b1ef603e4adaad55f27bfc55fb8f
I20260808 08:38:53.990245 26739 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:38:54.009478 26739 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:38:54.011570 26739 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:38:54.023762 26739 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd: Generated new TSK 0
I20260808 08:38:54.024873 26739 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.5.164.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
Entry for principal kudu/127.5.164.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab.
I20260808 08:38:54.122984 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:46155
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:35139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:38:54.470563 26755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:54.470858 26755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:54.470954 26755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:54.478796 26755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:54.478911 26755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:54.479022 26755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:38:54.489226 26755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:35139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.193.keytab
--principal=kudu/127.5.164.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:46155
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:54.490463 26755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:54.491760 26755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:54.505020 26760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:54.505013 26761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:54.505137 26764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:54.505946 26755 server_base.cc:1034] running on GCE node
I20260808 08:38:54.506579 26755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:54.507597 26755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:54.508791 26755 hybrid_clock.cc:648] HybridClock initialized: now 1786178334508734 us; error 56 us; skew 500 ppm
I20260808 08:38:54.509099 26755 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:38:54 dist-test-slave-chsk krb5kdc[26644](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178334, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:38:54.512418 26755 init.cc:377] Logged in from keytab as kudu/127.5.164.193@KRBTEST.COM (short username kudu)
I20260808 08:38:54.513931 26755 webserver.cc:460] Webserver started at http://127.5.164.193:45717/ using document root <none> and password file <none>
I20260808 08:38:54.514603 26755 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:54.514757 26755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:54.515080 26755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:54.518206 26755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "4553114a4ddc40b8bd7d9d3388873422"
format_stamp: "Formatted at 2026-08-08 08:38:54 on dist-test-slave-chsk"
server_key: "4788ad11f3fba023e0701df250d2b546"
server_key_iv: "d86d460d7b6dfb1f2e1bf1ff0e61ace0"
server_key_version: "encryptionkey@0"
I20260808 08:38:54.519050 26755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "4553114a4ddc40b8bd7d9d3388873422"
format_stamp: "Formatted at 2026-08-08 08:38:54 on dist-test-slave-chsk"
server_key: "4788ad11f3fba023e0701df250d2b546"
server_key_iv: "d86d460d7b6dfb1f2e1bf1ff0e61ace0"
server_key_version: "encryptionkey@0"
I20260808 08:38:54.524585 26755 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:38:54.528226 26771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:54.529516 26755 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:38:54.529712 26755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "4553114a4ddc40b8bd7d9d3388873422"
format_stamp: "Formatted at 2026-08-08 08:38:54 on dist-test-slave-chsk"
server_key: "4788ad11f3fba023e0701df250d2b546"
server_key_iv: "d86d460d7b6dfb1f2e1bf1ff0e61ace0"
server_key_version: "encryptionkey@0"
I20260808 08:38:54.529918 26755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:54.548233 26755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:54.552733 26755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:54.553040 26755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:54.554051 26755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:54.555457 26755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:54.555578 26755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:54.555733 26755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:54.555809 26755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:54.590924 26755 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:42823
I20260808 08:38:54.590976 26890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:42823 every 8 connection(s)
I20260808 08:38:54.592327 26755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:38:54.596525 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 26755
I20260808 08:38:54.596729 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:38:54.597321 5779 external_mini_cluster.cc:1428] Setting key 6da2873bd9d18a09ca5a37d87af89f6c
Aug 08 08:38:54 dist-test-slave-chsk krb5kdc[26644](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178334, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.193@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:38:54.621899 26893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:54.594976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:46603 (local address 127.5.164.254:46155)
0808 08:38:54.595492 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:54.595497 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:54.596465 (+ 968us) server_negotiation.cc:407] Connection header received
0808 08:38:54.598771 (+ 2306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:54.598778 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:54.598853 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:54.598975 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:54.601149 (+ 2174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:54.601868 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:54.604437 (+ 2569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:54.604857 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:54.604963 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:54.615242 (+ 10279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:54.615249 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:54.615252 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:54.615294 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:54.617996 (+ 2702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:54.619243 (+ 1247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:54.619248 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:54.619250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:54.619385 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:54.619932 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:54.619935 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:54.619937 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:54.620233 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:54.620351 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:54.621420 (+ 1069us) server_negotiation.cc:299] Negotiation successful
0808 08:38:54.621623 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":299,"threads_started":1}
I20260808 08:38:54.623672 26894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:54.595446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:46155 (local address 127.5.164.193:46603)
0808 08:38:54.596238 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:54.596295 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:54.598493 (+ 2198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:54.599300 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:54.599310 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:54.600084 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:54.600938 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:54.600968 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:54.602058 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:54.602066 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:54.604258 (+ 2192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:54.604277 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:54.605110 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:54.605121 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:54.605451 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:54.611692 (+ 6241us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:38:54.611752 (+ 60us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:54.614843 (+ 3091us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:54.618200 (+ 3357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:54.618213 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:54.618237 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:54.619025 (+ 788us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:54.619507 (+ 482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:54.619514 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:54.619520 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:54.619807 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:54.620379 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:54.620392 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:54.620969 (+ 577us) client_negotiation.cc:769] Sending connection context
0808 08:38:54.621318 (+ 349us) client_negotiation.cc:240] Negotiation successful
0808 08:38:54.621959 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":288,"threads_started":1}
I20260808 08:38:54.625502 26891 heartbeater.cc:347] Connected to a master server at 127.5.164.254:46155
I20260808 08:38:54.625864 26891 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:54.626652 26891 heartbeater.cc:511] Master 127.5.164.254:46155 requested a full tablet report, sending...
I20260808 08:38:54.628998 26690 ts_manager.cc:194] Registered new tserver with Master: 4553114a4ddc40b8bd7d9d3388873422 (127.5.164.193:42823)
I20260808 08:38:54.630543 26690 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.193@KRBTEST.COM'} at 127.5.164.193:46603
WARNING: no policy specified for kudu/127.5.164.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
Entry for principal kudu/127.5.164.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab.
I20260808 08:38:54.674661 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:46155
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:35139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:38:55.023931 26897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:55.024344 26897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:55.024519 26897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:55.032182 26897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:55.032343 26897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:55.032526 26897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:38:55.042788 26897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:35139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.194.keytab
--principal=kudu/127.5.164.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:46155
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:55.044296 26897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:55.045642 26897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:55.059222 26903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:55.059293 26905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:55.059289 26902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:55.060122 26897 server_base.cc:1034] running on GCE node
I20260808 08:38:55.060734 26897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:55.061702 26897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:55.062937 26897 hybrid_clock.cc:648] HybridClock initialized: now 1786178335062891 us; error 61 us; skew 500 ppm
I20260808 08:38:55.063345 26897 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:38:55 dist-test-slave-chsk krb5kdc[26644](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178335, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:38:55.066500 26897 init.cc:377] Logged in from keytab as kudu/127.5.164.194@KRBTEST.COM (short username kudu)
I20260808 08:38:55.068027 26897 webserver.cc:460] Webserver started at http://127.5.164.194:34421/ using document root <none> and password file <none>
I20260808 08:38:55.068738 26897 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:55.068893 26897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:55.069240 26897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:55.072270 26897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "4ed932f9d8ce4402829e1ad6b1febbcb"
format_stamp: "Formatted at 2026-08-08 08:38:55 on dist-test-slave-chsk"
server_key: "fbf0009e046c19c45100e109468d97c3"
server_key_iv: "7fdf255f01e0dd49b60c215d4c07238d"
server_key_version: "encryptionkey@0"
I20260808 08:38:55.073086 26897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "4ed932f9d8ce4402829e1ad6b1febbcb"
format_stamp: "Formatted at 2026-08-08 08:38:55 on dist-test-slave-chsk"
server_key: "fbf0009e046c19c45100e109468d97c3"
server_key_iv: "7fdf255f01e0dd49b60c215d4c07238d"
server_key_version: "encryptionkey@0"
I20260808 08:38:55.078876 26897 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 08:38:55.082639 26913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:55.084129 26897 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:38:55.084327 26897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "4ed932f9d8ce4402829e1ad6b1febbcb"
format_stamp: "Formatted at 2026-08-08 08:38:55 on dist-test-slave-chsk"
server_key: "fbf0009e046c19c45100e109468d97c3"
server_key_iv: "7fdf255f01e0dd49b60c215d4c07238d"
server_key_version: "encryptionkey@0"
I20260808 08:38:55.084551 26897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:55.112185 26897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:55.116806 26897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:55.117148 26897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:55.118283 26897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:55.119796 26897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:55.119912 26897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:55.120067 26897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:55.120142 26897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:55.156029 26897 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:43135
I20260808 08:38:55.156082 27033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:43135 every 8 connection(s)
I20260808 08:38:55.157431 26897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:38:55.159415 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 26897
I20260808 08:38:55.159626 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:38:55.160089 5779 external_mini_cluster.cc:1428] Setting key d1da2ab42e4633ee7b2acb236ca7bde9
Aug 08 08:38:55 dist-test-slave-chsk krb5kdc[26644](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178335, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.194@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:38:55.185132 27036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:55.160555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:44369 (local address 127.5.164.254:46155)
0808 08:38:55.167476 (+ 6921us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:55.167485 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:55.167506 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:38:55.167573 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:55.167580 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:55.167670 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:55.167803 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:55.169414 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.170659 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.172711 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.173497 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.173643 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:55.177618 (+ 3975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:55.177626 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:55.177634 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:55.177686 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:55.181440 (+ 3754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:55.182279 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:55.182287 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:55.182293 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:55.182462 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:55.182916 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:55.182924 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:55.182930 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:55.183360 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:55.183514 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:55.184266 (+ 752us) server_negotiation.cc:299] Negotiation successful
0808 08:38:55.184545 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6770,"thread_start_us":6640,"threads_started":1}
I20260808 08:38:55.185803 27037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:55.161215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:46155 (local address 127.5.164.194:44369)
0808 08:38:55.163824 (+ 2609us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:55.163890 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:55.166744 (+ 2854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:55.168039 (+ 1295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:55.168048 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:55.168621 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:55.169212 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:55.169230 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.170825 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.170829 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:55.172560 (+ 1731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:55.172574 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.173722 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.173726 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:55.173925 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:55.174766 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:38:55.174806 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:55.177333 (+ 2527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:55.181618 (+ 4285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:55.181625 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:55.181638 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:55.182125 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:55.182593 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:55.182596 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:55.182598 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:55.182775 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:55.183497 (+ 722us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:55.183503 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:55.183825 (+ 322us) client_negotiation.cc:769] Sending connection context
0808 08:38:55.184108 (+ 283us) client_negotiation.cc:240] Negotiation successful
0808 08:38:55.184520 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2256,"thread_start_us":1983,"threads_started":1}
I20260808 08:38:55.187471 27034 heartbeater.cc:347] Connected to a master server at 127.5.164.254:46155
I20260808 08:38:55.187794 27034 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:55.188633 27034 heartbeater.cc:511] Master 127.5.164.254:46155 requested a full tablet report, sending...
I20260808 08:38:55.190215 26690 ts_manager.cc:194] Registered new tserver with Master: 4ed932f9d8ce4402829e1ad6b1febbcb (127.5.164.194:43135)
I20260808 08:38:55.191206 26690 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.194@KRBTEST.COM'} at 127.5.164.194:44369
WARNING: no policy specified for kudu/127.5.164.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
Entry for principal kudu/127.5.164.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab.
I20260808 08:38:55.238276 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:46155
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:35139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:38:55.583011 27041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:55.583400 27041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:55.583587 27041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:55.591583 27041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:55.591720 27041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:55.591920 27041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:38:55.603833 27041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:35139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.195.keytab
--principal=kudu/127.5.164.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:46155
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:55.605005 27041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:55.606247 27041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:55.619063 27046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:55.619063 27049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:55.619071 27051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:55.620253 27041 server_base.cc:1034] running on GCE node
I20260808 08:38:55.620800 27041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:55.621706 27041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:55.622932 27041 hybrid_clock.cc:648] HybridClock initialized: now 1786178335622896 us; error 26 us; skew 500 ppm
I20260808 08:38:55.623301 27041 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:38:55 dist-test-slave-chsk krb5kdc[26644](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178335, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:38:55.626403 27041 init.cc:377] Logged in from keytab as kudu/127.5.164.195@KRBTEST.COM (short username kudu)
I20260808 08:38:55.627797 27041 webserver.cc:460] Webserver started at http://127.5.164.195:34027/ using document root <none> and password file <none>
I20260808 08:38:55.628427 27041 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:55.628531 27041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:55.628798 27041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:55.631677 27041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "647ea75ea40046ee96b8e880fe7f9baa"
format_stamp: "Formatted at 2026-08-08 08:38:55 on dist-test-slave-chsk"
server_key: "aa79948fde94396ac0f384d1af70f91a"
server_key_iv: "1f85567acd316e53928ad58c1853bfdd"
server_key_version: "encryptionkey@0"
I20260808 08:38:55.632433 27041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "647ea75ea40046ee96b8e880fe7f9baa"
format_stamp: "Formatted at 2026-08-08 08:38:55 on dist-test-slave-chsk"
server_key: "aa79948fde94396ac0f384d1af70f91a"
server_key_iv: "1f85567acd316e53928ad58c1853bfdd"
server_key_version: "encryptionkey@0"
I20260808 08:38:55.633665 26891 heartbeater.cc:503] Master 127.5.164.254:46155 was elected leader, sending a full tablet report...
I20260808 08:38:55.637688 27041 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:38:55.641031 27058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:55.642292 27041 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:38:55.642462 27041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "647ea75ea40046ee96b8e880fe7f9baa"
format_stamp: "Formatted at 2026-08-08 08:38:55 on dist-test-slave-chsk"
server_key: "aa79948fde94396ac0f384d1af70f91a"
server_key_iv: "1f85567acd316e53928ad58c1853bfdd"
server_key_version: "encryptionkey@0"
I20260808 08:38:55.642665 27041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:55.659551 27041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:55.663774 27041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:55.664052 27041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:55.664944 27041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:55.666190 27041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:55.666294 27041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:55.666452 27041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:55.666543 27041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:55.699990 27041 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:37447
I20260808 08:38:55.700073 27179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:37447 every 8 connection(s)
I20260808 08:38:55.701206 27041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:38:55.711279 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 27041
I20260808 08:38:55.711464 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:38:55.711915 5779 external_mini_cluster.cc:1428] Setting key 8053bea5f4be1340ead9aefb855ad330
Aug 08 08:38:55 dist-test-slave-chsk krb5kdc[26644](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178335, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.195@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:38:55.720264 27182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:55.703736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:35573 (local address 127.5.164.254:46155)
0808 08:38:55.704182 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:55.704187 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:55.704938 (+ 751us) server_negotiation.cc:407] Connection header received
0808 08:38:55.706753 (+ 1815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:55.706758 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:55.706860 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:55.706979 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:55.708404 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.709183 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.710663 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.711051 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.711206 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:55.715080 (+ 3874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:55.715084 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:55.715088 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:55.715126 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:55.717789 (+ 2663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:55.718411 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:55.718414 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:55.718416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:55.718525 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:55.718879 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:55.718882 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:55.718883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:55.719112 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:55.719293 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:55.719841 (+ 548us) server_negotiation.cc:299] Negotiation successful
0808 08:38:55.719989 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":247,"threads_started":1}
I20260808 08:38:55.721127 27183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:55.704118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:46155 (local address 127.5.164.195:35573)
0808 08:38:55.704782 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:55.704823 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:55.706471 (+ 1648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:55.707261 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:55.707268 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:55.707731 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:55.708243 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:55.708259 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.709363 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.709366 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:55.710518 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:55.710529 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.711300 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.711307 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:55.711609 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:55.712352 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:38:55.712381 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:55.714898 (+ 2517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:55.717902 (+ 3004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:55.717908 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:55.717918 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:55.718316 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:55.718616 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:38:55.718619 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:38:55.718621 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:38:55.718790 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:38:55.719278 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:55.719283 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:55.719550 (+ 267us) client_negotiation.cc:769] Sending connection context
0808 08:38:55.719759 (+ 209us) client_negotiation.cc:240] Negotiation successful
0808 08:38:55.720087 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":275,"threads_started":1}
I20260808 08:38:55.722384 27180 heartbeater.cc:347] Connected to a master server at 127.5.164.254:46155
I20260808 08:38:55.722657 27180 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:55.723404 27180 heartbeater.cc:511] Master 127.5.164.254:46155 requested a full tablet report, sending...
I20260808 08:38:55.724802 26690 ts_manager.cc:194] Registered new tserver with Master: 647ea75ea40046ee96b8e880fe7f9baa (127.5.164.195:37447)
I20260808 08:38:55.725906 26690 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.5.164.195@KRBTEST.COM'} at 127.5.164.195:35573
I20260808 08:38:55.727031 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:38:55.746999 27182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:55.732856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34400 (local address 127.5.164.254:46155)
0808 08:38:55.733451 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:55.733457 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:55.733695 (+ 238us) server_negotiation.cc:407] Connection header received
0808 08:38:55.733844 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:55.733852 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:55.733925 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:55.734025 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:55.736017 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.737058 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.738742 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.739192 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.739338 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:55.741648 (+ 2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:55.741657 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:55.741660 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:55.741692 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:55.744182 (+ 2490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:55.744835 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:55.744841 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:55.744845 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:55.744981 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:55.745381 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:55.745389 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:55.745392 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:55.745807 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:55.746090 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:55.746441 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 08:38:55.746663 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439}
I20260808 08:38:55.750728 26690 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34400:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:38:55.757581 26690 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:38:55.779227 27193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:55.769253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45096 (local address 127.5.164.194:43135)
0808 08:38:55.770767 (+ 1514us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:55.770774 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:55.770796 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:38:55.770870 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:55.770875 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:55.771047 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:55.771322 (+ 275us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:55.772031 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.773642 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.776559 (+ 2917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.777845 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.777992 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:55.778218 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:55.778704 (+ 486us) server_negotiation.cc:299] Negotiation successful
0808 08:38:55.778892 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1348,"thread_start_us":1233,"threads_started":1}
I20260808 08:38:55.779390 27194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:55.769283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:43135 (local address 127.0.0.1:45096)
0808 08:38:55.770031 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:55.770080 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:55.770242 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:55.771325 (+ 1083us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:55.771332 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:55.771361 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:55.771805 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:55.771822 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.773812 (+ 1990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.773819 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:55.776365 (+ 2546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:55.776377 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.778089 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.778094 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:55.778342 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:55.778487 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 08:38:55.778643 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 08:38:55.778848 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"mutex_wait_us":57,"thread_start_us":355,"threads_started":1}
I20260808 08:38:55.782651 27196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:55.770998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39024 (local address 127.5.164.195:37447)
0808 08:38:55.774744 (+ 3746us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:55.774750 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:55.774773 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:38:55.774842 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:55.774846 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:55.775134 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:55.775406 (+ 272us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:55.776224 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.777813 (+ 1589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.780500 (+ 2687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.781566 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.781707 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:55.781931 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:55.782169 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 08:38:55.782321 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3567,"thread_start_us":3396,"threads_started":1}
I20260808 08:38:55.782682 27195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:55.770559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:37447 (local address 127.0.0.1:39024)
0808 08:38:55.772004 (+ 1445us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:55.772022 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:55.772130 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:55.775420 (+ 3290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:55.775425 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:55.775455 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:55.776016 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:55.776029 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.777942 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.777950 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:55.780312 (+ 2362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:55.780326 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.781788 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.781795 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:55.781971 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:55.782020 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 08:38:55.782119 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 08:38:55.782244 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1325,"mutex_wait_us":6,"thread_start_us":1170,"threads_started":1}
I20260808 08:38:55.783347 27198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:55.772987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42823 (local address 127.0.0.1:36388)
0808 08:38:55.773622 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:55.773640 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:55.773757 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:55.774970 (+ 1213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:55.774977 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:55.775009 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:55.775553 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:55.775573 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.777781 (+ 2208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.777787 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:55.780369 (+ 2582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:55.780384 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.782532 (+ 2148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.782538 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:55.782728 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:55.782759 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 08:38:55.782851 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 08:38:55.782968 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"mutex_wait_us":34,"thread_start_us":382,"threads_started":1}
I20260808 08:38:55.783527 27197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:55.772555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36388 (local address 127.5.164.193:42823)
0808 08:38:55.774408 (+ 1853us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:55.774420 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:55.774450 (+ 30us) server_negotiation.cc:407] Connection header received
0808 08:38:55.774546 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:55.774554 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:55.774769 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:55.774963 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:55.775828 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.777633 (+ 1805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.780569 (+ 2936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:55.782007 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:55.782147 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:55.782376 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:55.783022 (+ 646us) server_negotiation.cc:299] Negotiation successful
0808 08:38:55.783220 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1683,"thread_start_us":1427,"threads_started":1}
I20260808 08:38:55.783492 26965 tablet_service.cc:1467] Processing CreateTablet for tablet 863044837c9d4f7a8be6411b5e362d59 (DEFAULT_TABLE table=test-table [id=93a6c37d5a65432fabfd878c7304d3c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:55.785096 26965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 863044837c9d4f7a8be6411b5e362d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:55.786623 26823 tablet_service.cc:1467] Processing CreateTablet for tablet 863044837c9d4f7a8be6411b5e362d59 (DEFAULT_TABLE table=test-table [id=93a6c37d5a65432fabfd878c7304d3c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:55.786535 27108 tablet_service.cc:1467] Processing CreateTablet for tablet 863044837c9d4f7a8be6411b5e362d59 (DEFAULT_TABLE table=test-table [id=93a6c37d5a65432fabfd878c7304d3c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:55.787840 26823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 863044837c9d4f7a8be6411b5e362d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:55.788013 27108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 863044837c9d4f7a8be6411b5e362d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:55.800006 27199 tablet_bootstrap.cc:492] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422: Bootstrap starting.
I20260808 08:38:55.803275 27199 tablet_bootstrap.cc:654] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:55.803951 27200 tablet_bootstrap.cc:492] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb: Bootstrap starting.
I20260808 08:38:55.804744 27199 log.cc:824] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:55.806311 27201 tablet_bootstrap.cc:492] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa: Bootstrap starting.
I20260808 08:38:55.807878 27200 tablet_bootstrap.cc:654] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:55.808261 27199 tablet_bootstrap.cc:492] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422: No bootstrap required, opened a new log
I20260808 08:38:55.808557 27199 ts_tablet_manager.cc:1397] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260808 08:38:55.809126 27200 log.cc:824] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:55.810758 27201 tablet_bootstrap.cc:654] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:55.811758 27200 tablet_bootstrap.cc:492] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb: No bootstrap required, opened a new log
I20260808 08:38:55.812016 27200 ts_tablet_manager.cc:1397] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.006s
I20260808 08:38:55.812013 27201 log.cc:824] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:55.815241 27201 tablet_bootstrap.cc:492] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa: No bootstrap required, opened a new log
I20260808 08:38:55.815516 27201 ts_tablet_manager.cc:1397] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.005s
I20260808 08:38:55.819459 27199 raft_consensus.cc:348] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed932f9d8ce4402829e1ad6b1febbcb" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 43135 } } peers { permanent_uuid: "647ea75ea40046ee96b8e880fe7f9baa" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 37447 } } peers { permanent_uuid: "4553114a4ddc40b8bd7d9d3388873422" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42823 } }
I20260808 08:38:55.820114 27199 raft_consensus.cc:374] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:55.820230 27199 raft_consensus.cc:729] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4553114a4ddc40b8bd7d9d3388873422, State: Initialized, Role: FOLLOWER
I20260808 08:38:55.820966 27199 consensus_queue.cc:260] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed932f9d8ce4402829e1ad6b1febbcb" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 43135 } } peers { permanent_uuid: "647ea75ea40046ee96b8e880fe7f9baa" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 37447 } } peers { permanent_uuid: "4553114a4ddc40b8bd7d9d3388873422" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42823 } }
I20260808 08:38:55.821329 27200 raft_consensus.cc:348] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed932f9d8ce4402829e1ad6b1febbcb" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 43135 } } peers { permanent_uuid: "647ea75ea40046ee96b8e880fe7f9baa" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 37447 } } peers { permanent_uuid: "4553114a4ddc40b8bd7d9d3388873422" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42823 } }
I20260808 08:38:55.821740 27200 raft_consensus.cc:374] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:55.821904 27200 raft_consensus.cc:729] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ed932f9d8ce4402829e1ad6b1febbcb, State: Initialized, Role: FOLLOWER
I20260808 08:38:55.822646 27200 consensus_queue.cc:260] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed932f9d8ce4402829e1ad6b1febbcb" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 43135 } } peers { permanent_uuid: "647ea75ea40046ee96b8e880fe7f9baa" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 37447 } } peers { permanent_uuid: "4553114a4ddc40b8bd7d9d3388873422" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42823 } }
I20260808 08:38:55.823120 27199 ts_tablet_manager.cc:1428] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260808 08:38:55.824083 27034 heartbeater.cc:503] Master 127.5.164.254:46155 was elected leader, sending a full tablet report...
I20260808 08:38:55.824689 27200 ts_tablet_manager.cc:1428] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb: Time spent starting tablet: real 0.013s user 0.008s sys 0.003s
I20260808 08:38:55.826016 27201 raft_consensus.cc:348] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed932f9d8ce4402829e1ad6b1febbcb" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 43135 } } peers { permanent_uuid: "647ea75ea40046ee96b8e880fe7f9baa" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 37447 } } peers { permanent_uuid: "4553114a4ddc40b8bd7d9d3388873422" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42823 } }
I20260808 08:38:55.826388 27201 raft_consensus.cc:374] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:55.826514 27201 raft_consensus.cc:729] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 647ea75ea40046ee96b8e880fe7f9baa, State: Initialized, Role: FOLLOWER
I20260808 08:38:55.827363 27201 consensus_queue.cc:260] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed932f9d8ce4402829e1ad6b1febbcb" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 43135 } } peers { permanent_uuid: "647ea75ea40046ee96b8e880fe7f9baa" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 37447 } } peers { permanent_uuid: "4553114a4ddc40b8bd7d9d3388873422" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42823 } }
I20260808 08:38:55.828474 27180 heartbeater.cc:503] Master 127.5.164.254:46155 was elected leader, sending a full tablet report...
I20260808 08:38:55.829140 27201 ts_tablet_manager.cc:1428] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa: Time spent starting tablet: real 0.014s user 0.005s sys 0.008s
W20260808 08:38:55.844789 26892 tablet.cc:2369] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:38:55.909973 27035 tablet.cc:2369] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:38:55.952903 27181 tablet.cc:2369] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:38:56.101822 27207 raft_consensus.cc:482] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:38:56.102123 27207 raft_consensus.cc:504] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed932f9d8ce4402829e1ad6b1febbcb" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 43135 } } peers { permanent_uuid: "647ea75ea40046ee96b8e880fe7f9baa" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 37447 } } peers { permanent_uuid: "4553114a4ddc40b8bd7d9d3388873422" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42823 } }
I20260808 08:38:56.103873 27207 leader_election.cc:288] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ed932f9d8ce4402829e1ad6b1febbcb (127.5.164.194:43135), 647ea75ea40046ee96b8e880fe7f9baa (127.5.164.195:37447)
I20260808 08:38:56.111359 27210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:56.104343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:43135 (local address 127.5.164.193:42203)
0808 08:38:56.104968 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:56.104985 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:56.105166 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:56.105544 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:56.105548 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:56.105582 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:56.106071 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:56.106083 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:56.107352 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:56.107355 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:56.109319 (+ 1964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:56.109334 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:56.110661 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:56.110665 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:56.110782 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:56.110806 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 08:38:56.110886 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 08:38:56.110972 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":364,"threads_started":1}
I20260808 08:38:56.111390 27193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:56.104426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:42203 (local address 127.5.164.194:43135)
0808 08:38:56.104736 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:56.104744 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:56.105107 (+ 363us) server_negotiation.cc:407] Connection header received
0808 08:38:56.105358 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:56.105362 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:56.105423 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:56.105523 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:56.106223 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:56.107222 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:56.109478 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:56.110459 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:56.110602 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:56.110677 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:56.110938 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 08:38:56.111074 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 08:38:56.112181 27196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:56.105564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:57277 (local address 127.5.164.195:37447)
0808 08:38:56.105833 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:56.105839 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:56.106337 (+ 498us) server_negotiation.cc:407] Connection header received
0808 08:38:56.106453 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:56.106458 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:56.106535 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:56.106628 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:56.107105 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:56.107916 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:56.110019 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:56.111143 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:56.111330 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:56.111405 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:56.111804 (+ 399us) server_negotiation.cc:299] Negotiation successful
0808 08:38:56.111931 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260808 08:38:56.112214 27212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:56.105219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:37447 (local address 127.5.164.193:57277)
0808 08:38:56.106228 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:56.106247 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:56.106352 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:56.106656 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:56.106659 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:56.106678 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:56.106957 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:56.106964 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:56.108073 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:56.108079 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:56.109873 (+ 1794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:56.109883 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:56.111408 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:56.111415 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:56.111604 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:56.111642 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 08:38:56.111772 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 08:38:56.111897 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":905,"thread_start_us":634,"threads_started":1}
I20260808 08:38:56.112429 26988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863044837c9d4f7a8be6411b5e362d59" candidate_uuid: "4553114a4ddc40b8bd7d9d3388873422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ed932f9d8ce4402829e1ad6b1febbcb" is_pre_election: true
I20260808 08:38:56.113070 26988 raft_consensus.cc:2454] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4553114a4ddc40b8bd7d9d3388873422 in term 0.
I20260808 08:38:56.113338 27130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863044837c9d4f7a8be6411b5e362d59" candidate_uuid: "4553114a4ddc40b8bd7d9d3388873422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "647ea75ea40046ee96b8e880fe7f9baa" is_pre_election: true
I20260808 08:38:56.113835 26774 leader_election.cc:302] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4553114a4ddc40b8bd7d9d3388873422, 4ed932f9d8ce4402829e1ad6b1febbcb; no voters:
I20260808 08:38:56.113840 27130 raft_consensus.cc:2454] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4553114a4ddc40b8bd7d9d3388873422 in term 0.
I20260808 08:38:56.114269 27207 raft_consensus.cc:2781] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:38:56.114444 27207 raft_consensus.cc:482] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:38:56.114578 27207 raft_consensus.cc:3037] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:56.116861 27207 raft_consensus.cc:504] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed932f9d8ce4402829e1ad6b1febbcb" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 43135 } } peers { permanent_uuid: "647ea75ea40046ee96b8e880fe7f9baa" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 37447 } } peers { permanent_uuid: "4553114a4ddc40b8bd7d9d3388873422" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42823 } }
I20260808 08:38:56.117429 27207 leader_election.cc:288] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [CANDIDATE]: Term 1 election: Requested vote from peers 4ed932f9d8ce4402829e1ad6b1febbcb (127.5.164.194:43135), 647ea75ea40046ee96b8e880fe7f9baa (127.5.164.195:37447)
I20260808 08:38:56.117970 26988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863044837c9d4f7a8be6411b5e362d59" candidate_uuid: "4553114a4ddc40b8bd7d9d3388873422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ed932f9d8ce4402829e1ad6b1febbcb"
I20260808 08:38:56.118021 27130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863044837c9d4f7a8be6411b5e362d59" candidate_uuid: "4553114a4ddc40b8bd7d9d3388873422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "647ea75ea40046ee96b8e880fe7f9baa"
I20260808 08:38:56.118170 26988 raft_consensus.cc:3037] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:56.118242 27130 raft_consensus.cc:3037] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:56.120450 26988 raft_consensus.cc:2454] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4553114a4ddc40b8bd7d9d3388873422 in term 1.
I20260808 08:38:56.120607 27130 raft_consensus.cc:2454] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4553114a4ddc40b8bd7d9d3388873422 in term 1.
I20260808 08:38:56.120864 26774 leader_election.cc:302] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4553114a4ddc40b8bd7d9d3388873422, 4ed932f9d8ce4402829e1ad6b1febbcb; no voters:
I20260808 08:38:56.121150 27207 raft_consensus.cc:2781] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:38:56.121601 27207 raft_consensus.cc:686] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [term 1 LEADER]: Becoming Leader. State: Replica: 4553114a4ddc40b8bd7d9d3388873422, State: Running, Role: LEADER
I20260808 08:38:56.122089 27207 consensus_queue.cc:237] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed932f9d8ce4402829e1ad6b1febbcb" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 43135 } } peers { permanent_uuid: "647ea75ea40046ee96b8e880fe7f9baa" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 37447 } } peers { permanent_uuid: "4553114a4ddc40b8bd7d9d3388873422" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42823 } }
I20260808 08:38:56.126809 26690 catalog_manager.cc:5495] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4553114a4ddc40b8bd7d9d3388873422 (127.5.164.193). New cstate: current_term: 1 leader_uuid: "4553114a4ddc40b8bd7d9d3388873422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ed932f9d8ce4402829e1ad6b1febbcb" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 43135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "647ea75ea40046ee96b8e880fe7f9baa" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 37447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4553114a4ddc40b8bd7d9d3388873422" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 42823 } health_report { overall_health: HEALTHY } } }
I20260808 08:38:56.145330 27197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:56.139939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36400 (local address 127.5.164.193:42823)
0808 08:38:56.140204 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:56.140212 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:56.140292 (+ 80us) server_negotiation.cc:407] Connection header received
0808 08:38:56.140537 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:56.140541 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:56.140633 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:56.140760 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:38:56.141138 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:56.141848 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:56.143281 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:56.143678 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:56.143772 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:56.144259 (+ 487us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:38:56.144744 (+ 485us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:38:56.144849 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:56.144922 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 08:38:56.144987 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260808 08:38:56.153385 27130 raft_consensus.cc:1261] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa [term 1 FOLLOWER]: Refusing update from remote peer 4553114a4ddc40b8bd7d9d3388873422: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:38:56.153388 26988 raft_consensus.cc:1261] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb [term 1 FOLLOWER]: Refusing update from remote peer 4553114a4ddc40b8bd7d9d3388873422: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:38:56.154351 27213 consensus_queue.cc:1035] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ed932f9d8ce4402829e1ad6b1febbcb" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 43135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:38:56.154714 27207 consensus_queue.cc:1035] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "647ea75ea40046ee96b8e880fe7f9baa" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 37447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:38:56.166340 27216 mvcc.cc:205] Tried to move back new op lower bound from 7316186464874094592 to 7316186464759517184. Current Snapshot: MvccSnapshot[applied={T|T < 7316186464874094592}]
I20260808 08:38:56.168097 27217 mvcc.cc:205] Tried to move back new op lower bound from 7316186464874094592 to 7316186464759517184. Current Snapshot: MvccSnapshot[applied={T|T < 7316186464874094592}]
I20260808 08:38:56.187759 26690 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:38:56.188097 26690 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:38:56.192950 26690 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 478f55412e8b4eb5b7c9ad725576dffd: Sending DeleteTablet for 3 replicas of tablet 863044837c9d4f7a8be6411b5e362d59
I20260808 08:38:56.194244 26823 tablet_service.cc:1514] Processing DeleteTablet for tablet 863044837c9d4f7a8be6411b5e362d59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:56 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:36388
I20260808 08:38:56.194797 26965 tablet_service.cc:1514] Processing DeleteTablet for tablet 863044837c9d4f7a8be6411b5e362d59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:56 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:45096
I20260808 08:38:56.195039 27108 tablet_service.cc:1514] Processing DeleteTablet for tablet 863044837c9d4f7a8be6411b5e362d59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:56 UTC) from {username='kudu', principal='kudu/127.5.164.254@KRBTEST.COM'} at 127.0.0.1:39024
I20260808 08:38:56.197929 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 26755
I20260808 08:38:56.221380 27228 tablet_replica.cc:330] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa: stopping tablet replica
I20260808 08:38:56.221928 27228 raft_consensus.cc:2229] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:38:56.222486 27228 raft_consensus.cc:2258] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:38:56.223805 27226 tablet_replica.cc:330] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422: stopping tablet replica
I20260808 08:38:56.224105 27227 tablet_replica.cc:330] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb: stopping tablet replica
I20260808 08:38:56.224526 27227 raft_consensus.cc:2229] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:38:56.225032 27227 raft_consensus.cc:2258] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:38:56.224236 27226 raft_consensus.cc:2229] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:38:56.226059 27226 raft_consensus.cc:2258] T 863044837c9d4f7a8be6411b5e362d59 P 4553114a4ddc40b8bd7d9d3388873422 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 08 08:38:56 dist-test-slave-chsk krb5kdc[26644](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.193@KRBTEST.COM
I20260808 08:38:56.227123 27228 ts_tablet_manager.cc:1905] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:38:56.228003 27227 ts_tablet_manager.cc:1905] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:38:56.234841 27227 ts_tablet_manager.cc:1918] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:56.234905 27228 ts_tablet_manager.cc:1918] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:56.235035 27227 log.cc:1196] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/863044837c9d4f7a8be6411b5e362d59
I20260808 08:38:56.235064 27228 log.cc:1196] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/863044837c9d4f7a8be6411b5e362d59
I20260808 08:38:56.235605 27228 ts_tablet_manager.cc:1939] T 863044837c9d4f7a8be6411b5e362d59 P 647ea75ea40046ee96b8e880fe7f9baa: Deleting consensus metadata
I20260808 08:38:56.235607 27227 ts_tablet_manager.cc:1939] T 863044837c9d4f7a8be6411b5e362d59 P 4ed932f9d8ce4402829e1ad6b1febbcb: Deleting consensus metadata
I20260808 08:38:56.235881 27197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:56.200081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36412 (local address 127.5.164.193:42823)
0808 08:38:56.200259 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:56.200265 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:56.211550 (+ 11285us) server_negotiation.cc:407] Connection header received
0808 08:38:56.212093 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:56.212102 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:56.212225 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:56.212319 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:56.215481 (+ 3162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:56.217149 (+ 1668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:56.219803 (+ 2654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:56.220839 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:56.220964 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:56.227812 (+ 6848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:56.227828 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:56.227844 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:56.227905 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:56.231978 (+ 4073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:56.232968 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:56.232976 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:56.232980 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:56.233207 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:56.233692 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:56.233697 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:56.233701 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:56.234253 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:56.234553 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:56.235231 (+ 678us) server_negotiation.cc:299] Negotiation successful
0808 08:38:56.235484 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 08:38:56.237365 26885 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:56.237452 26676 catalog_manager.cc:4841] TS 4ed932f9d8ce4402829e1ad6b1febbcb (127.5.164.194:43135): tablet 863044837c9d4f7a8be6411b5e362d59 (table test-table [id=93a6c37d5a65432fabfd878c7304d3c4]) successfully deleted
I20260808 08:38:56.237797 26676 catalog_manager.cc:4841] TS 647ea75ea40046ee96b8e880fe7f9baa (127.5.164.195:37447): tablet 863044837c9d4f7a8be6411b5e362d59 (table test-table [id=93a6c37d5a65432fabfd878c7304d3c4]) successfully deleted
I20260808 08:38:56.335978 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 26755
W20260808 08:38:56.358902 26676 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.164.193:42823 (error 108)
I20260808 08:38:56.359652 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 26897
I20260808 08:38:56.361078 27232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:56.360245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42823 (local address 127.0.0.1:36414)
0808 08:38:56.360708 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:56.360854 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":232,"threads_started":1}
W20260808 08:38:56.361404 26676 catalog_manager.cc:4584] TS 4553114a4ddc40b8bd7d9d3388873422 (127.5.164.193:42823): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 863044837c9d4f7a8be6411b5e362d59: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42823: connect: Connection refused (error 111)
Aug 08 08:38:56 dist-test-slave-chsk krb5kdc[26644](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.194@KRBTEST.COM
I20260808 08:38:56.375368 27193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:56.360485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45112 (local address 127.5.164.194:43135)
0808 08:38:56.360673 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:56.360679 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:56.360750 (+ 71us) server_negotiation.cc:407] Connection header received
0808 08:38:56.360978 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:56.360983 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:56.361048 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:56.361131 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:56.362664 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:56.363546 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:56.364778 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:56.365182 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:56.365276 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:56.369540 (+ 4264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:56.369554 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:56.369568 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:56.369600 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:56.372632 (+ 3032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:56.373244 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:56.373251 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:56.373253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:56.373383 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:56.373715 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:56.373718 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:56.373720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:56.374108 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:56.374446 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:56.374769 (+ 323us) server_negotiation.cc:299] Negotiation successful
0808 08:38:56.374992 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:38:56.376134 27029 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:56.415230 27232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:56.414664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42823 (local address 127.0.0.1:36424)
0808 08:38:56.414912 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:56.415026 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260808 08:38:56.416320 27232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:56.415925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42823 (local address 127.0.0.1:36438)
0808 08:38:56.416077 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:56.416162 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 08:38:56.466809 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 26897
I20260808 08:38:56.476809 27232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:56.476286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42823 (local address 127.0.0.1:36452)
0808 08:38:56.476516 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:56.476614 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 08:38:56.477957 27232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:56.477587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42823 (local address 127.0.0.1:36458)
0808 08:38:56.477719 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:56.477810 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 08:38:56.489161 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 27041
Aug 08 08:38:56 dist-test-slave-chsk krb5kdc[26644](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.195@KRBTEST.COM
I20260808 08:38:56.505735 27196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:56.489918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39030 (local address 127.5.164.195:37447)
0808 08:38:56.490109 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:56.490114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:56.490132 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:38:56.490347 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:56.490351 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:56.490433 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:56.490528 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:56.492063 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:56.492813 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:56.494704 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:56.495088 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:56.495275 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:56.499976 (+ 4701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:56.499992 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:56.500009 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:38:56.500043 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:56.503323 (+ 3280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:56.503980 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:56.503987 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:56.503989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:56.504137 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:38:56.504478 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:38:56.504481 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:38:56.504483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:38:56.504857 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:56.505075 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:56.505307 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 08:38:56.505468 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:38:56.506363 27174 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:56.559306 27232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:56.558721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42823 (local address 127.0.0.1:36460)
0808 08:38:56.558989 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:56.559079 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260808 08:38:56.560449 27232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:56.560020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:42823 (local address 127.0.0.1:36470)
0808 08:38:56.560228 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:56.560311 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:42823: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260808 08:38:56.596652 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 27041
I20260808 08:38:56.616667 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 26657
I20260808 08:38:56.617798 26721 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:56.729753 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 26657
2026-08-08T08:38:56Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4763 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T08:38:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:38:56Z Disabled control of system clock
I20260808 08:38:56.827023 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:43769
--webserver_interface=127.5.164.254
--webserver_port=0
--builtin_ntp_servers=127.5.164.212:38275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:43769
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:38:57.173498 27239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:57.173792 27239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:57.173923 27239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:57.181273 27239 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:38:57.181423 27239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:57.181499 27239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:57.181612 27239 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:38:57.181689 27239 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:38:57.191699 27239 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:43769
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:43769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:57.193030 27239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:57.194972 27239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:57.206748 27245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:57.206827 27246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:57.206827 27249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:57.207813 27239 server_base.cc:1034] running on GCE node
I20260808 08:38:57.208658 27239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:57.210059 27239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:57.211244 27239 hybrid_clock.cc:648] HybridClock initialized: now 1786178337211197 us; error 43 us; skew 500 ppm
I20260808 08:38:57.211633 27239 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:38:57.213928 27239 webserver.cc:460] Webserver started at http://127.5.164.254:39841/ using document root <none> and password file <none>
I20260808 08:38:57.214636 27239 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:57.214757 27239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:57.215112 27239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:57.218093 27239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "3f26c161306c42b4b774ecb45bebe090"
format_stamp: "Formatted at 2026-08-08 08:38:57 on dist-test-slave-chsk"
server_key: "048b702c909983f5f309a14a94f5b64f"
server_key_iv: "95b991975334d768a4089f6e15831d2c"
server_key_version: "encryptionkey@0"
I20260808 08:38:57.218933 27239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "3f26c161306c42b4b774ecb45bebe090"
format_stamp: "Formatted at 2026-08-08 08:38:57 on dist-test-slave-chsk"
server_key: "048b702c909983f5f309a14a94f5b64f"
server_key_iv: "95b991975334d768a4089f6e15831d2c"
server_key_version: "encryptionkey@0"
I20260808 08:38:57.224359 27239 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260808 08:38:57.227998 27256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:57.229427 27239 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 08:38:57.229632 27239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "3f26c161306c42b4b774ecb45bebe090"
format_stamp: "Formatted at 2026-08-08 08:38:57 on dist-test-slave-chsk"
server_key: "048b702c909983f5f309a14a94f5b64f"
server_key_iv: "95b991975334d768a4089f6e15831d2c"
server_key_version: "encryptionkey@0"
I20260808 08:38:57.229874 27239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:57.247490 27239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:57.248397 27239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:57.248718 27239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:57.267570 27239 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:43769
I20260808 08:38:57.267581 27308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:43769 every 8 connection(s)
I20260808 08:38:57.268935 27239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:38:57.272588 27309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:57.278846 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 27239
I20260808 08:38:57.279031 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:38:57.279538 5779 external_mini_cluster.cc:1428] Setting key 2ea15a06bab3a9dfd9238b60bedf9c65
I20260808 08:38:57.283317 27309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090: Bootstrap starting.
I20260808 08:38:57.286520 27309 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:57.287673 27309 log.cc:824] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:57.290397 27309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090: No bootstrap required, opened a new log
I20260808 08:38:57.293059 27312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:57.281458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43646 (local address 127.5.164.254:43769)
0808 08:38:57.282408 (+ 950us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:57.282419 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:57.282460 (+ 41us) server_negotiation.cc:407] Connection header received
0808 08:38:57.284340 (+ 1880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:57.284362 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:57.284824 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:57.285213 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:57.285774 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:57.287220 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:57.288625 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:57.289304 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:57.289502 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:57.290681 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:57.290689 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:57.290701 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:57.291311 (+ 610us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:57.291392 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:57.291413 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:57.291550 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:57.291773 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 08:38:57.292086 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":323,"threads_started":1}
I20260808 08:38:57.298437 27309 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f26c161306c42b4b774ecb45bebe090" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43769 } }
I20260808 08:38:57.298882 27309 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:57.299021 27309 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f26c161306c42b4b774ecb45bebe090, State: Initialized, Role: FOLLOWER
I20260808 08:38:57.299566 27309 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f26c161306c42b4b774ecb45bebe090" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43769 } }
I20260808 08:38:57.299782 27309 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:38:57.299878 27309 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:38:57.300002 27309 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:57.302126 27309 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f26c161306c42b4b774ecb45bebe090" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43769 } }
I20260808 08:38:57.302554 27309 leader_election.cc:302] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f26c161306c42b4b774ecb45bebe090; no voters:
I20260808 08:38:57.303071 27309 leader_election.cc:288] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:38:57.303285 27314 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:38:57.304224 27314 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [term 1 LEADER]: Becoming Leader. State: Replica: 3f26c161306c42b4b774ecb45bebe090, State: Running, Role: LEADER
I20260808 08:38:57.304791 27314 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f26c161306c42b4b774ecb45bebe090" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43769 } }
I20260808 08:38:57.305341 27309 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:38:57.307942 27316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f26c161306c42b4b774ecb45bebe090. Latest consensus state: current_term: 1 leader_uuid: "3f26c161306c42b4b774ecb45bebe090" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f26c161306c42b4b774ecb45bebe090" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43769 } } }
I20260808 08:38:57.308391 27316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [sys.catalog]: This master's current role is: LEADER
I20260808 08:38:57.308652 27315 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f26c161306c42b4b774ecb45bebe090" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f26c161306c42b4b774ecb45bebe090" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43769 } } }
I20260808 08:38:57.309007 27315 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090 [sys.catalog]: This master's current role is: LEADER
I20260808 08:38:57.310258 27324 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:38:57.316762 27324 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:38:57.325713 27324 catalog_manager.cc:1347] Generated new cluster ID: e3916b384d254f6495c36de7fedb4661
I20260808 08:38:57.325845 27324 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:38:57.341578 27324 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:38:57.342804 27324 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:38:57.352531 27324 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090: Generated new TSK 0
I20260808 08:38:57.353359 27324 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:38:57.366371 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.193:0
--local_ip_for_outbound_sockets=127.5.164.193
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43769
--builtin_ntp_servers=127.5.164.212:38275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 08:38:57.712018 27337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:57.712333 27337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:57.712481 27337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:57.719853 27337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:57.719952 27337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:57.720126 27337 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.193
I20260808 08:38:57.729707 27337 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.5.164.193
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43769
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.193
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:57.731613 27337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:57.734478 27337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:57.748381 27345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:57.748456 27343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:57.748409 27342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:57.749636 27337 server_base.cc:1034] running on GCE node
I20260808 08:38:57.750347 27337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:57.751381 27337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:57.752627 27337 hybrid_clock.cc:648] HybridClock initialized: now 1786178337752567 us; error 77 us; skew 500 ppm
I20260808 08:38:57.752961 27337 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:38:57.755360 27337 webserver.cc:460] Webserver started at http://127.5.164.193:39157/ using document root <none> and password file <none>
I20260808 08:38:57.756059 27337 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:57.756198 27337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:57.756537 27337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:57.759466 27337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/data/instance:
uuid: "4440be15e9244e70bface23879b49e8f"
format_stamp: "Formatted at 2026-08-08 08:38:57 on dist-test-slave-chsk"
server_key: "f979aec8bfe67764921c0759308f2c91"
server_key_iv: "f8c341753347ce814fea131b1e757bf0"
server_key_version: "encryptionkey@0"
I20260808 08:38:57.760319 27337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance:
uuid: "4440be15e9244e70bface23879b49e8f"
format_stamp: "Formatted at 2026-08-08 08:38:57 on dist-test-slave-chsk"
server_key: "f979aec8bfe67764921c0759308f2c91"
server_key_iv: "f8c341753347ce814fea131b1e757bf0"
server_key_version: "encryptionkey@0"
I20260808 08:38:57.765622 27337 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:38:57.769150 27352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:57.770445 27337 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:38:57.770629 27337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/wal
uuid: "4440be15e9244e70bface23879b49e8f"
format_stamp: "Formatted at 2026-08-08 08:38:57 on dist-test-slave-chsk"
server_key: "f979aec8bfe67764921c0759308f2c91"
server_key_iv: "f8c341753347ce814fea131b1e757bf0"
server_key_version: "encryptionkey@0"
I20260808 08:38:57.770875 27337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:57.786401 27337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:57.787300 27337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:57.787618 27337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:57.788551 27337 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:57.790087 27337 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:57.790215 27337 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:57.790362 27337 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:57.790453 27337 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:57.824744 27337 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.193:37469
I20260808 08:38:57.824836 27474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.193:37469 every 8 connection(s)
I20260808 08:38:57.826049 27337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/data/info.pb
I20260808 08:38:57.830188 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 27337
I20260808 08:38:57.830395 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/wal/instance
I20260808 08:38:57.830817 5779 external_mini_cluster.cc:1428] Setting key d35384e295cc5d4eb8362d731aa506bb
I20260808 08:38:57.833843 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.194:0
--local_ip_for_outbound_sockets=127.5.164.194
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43769
--builtin_ntp_servers=127.5.164.212:38275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:38:57.838950 27477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:57.828565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:51251 (local address 127.5.164.254:43769)
0808 08:38:57.829042 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:57.829049 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:57.830172 (+ 1123us) server_negotiation.cc:407] Connection header received
0808 08:38:57.832219 (+ 2047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:57.832223 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:57.832283 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:57.832371 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:57.833465 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:57.834437 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:57.836130 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:57.836534 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:57.836671 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:57.838092 (+ 1421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:57.838096 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:57.838100 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:57.838118 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:57.838161 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:57.838173 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:57.838278 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:57.838512 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 08:38:57.838610 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":238,"threads_started":1}
I20260808 08:38:57.839968 27478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:57.829139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:43769 (local address 127.5.164.193:51251)
0808 08:38:57.830010 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:57.830049 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:57.831947 (+ 1898us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:57.832626 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:57.832633 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:57.832710 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:57.833302 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:57.833317 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:57.834613 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:57.834617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:57.835984 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:57.835997 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:57.836783 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:57.836790 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:57.837026 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:57.837768 (+ 742us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:38:57.837771 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:57.837809 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:38:57.837899 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:57.838279 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:57.838293 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:57.838302 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 08:38:57.838488 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 08:38:57.838879 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":273,"threads_started":1}
I20260808 08:38:57.841528 27475 heartbeater.cc:347] Connected to a master server at 127.5.164.254:43769
I20260808 08:38:57.841826 27475 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:57.842567 27475 heartbeater.cc:511] Master 127.5.164.254:43769 requested a full tablet report, sending...
I20260808 08:38:57.844803 27273 ts_manager.cc:194] Registered new tserver with Master: 4440be15e9244e70bface23879b49e8f (127.5.164.193:37469)
I20260808 08:38:57.846923 27273 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.164.193:51251
W20260808 08:38:58.177910 27479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:58.178243 27479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:58.178404 27479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:58.185801 27479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:58.185945 27479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:58.186131 27479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.194
I20260808 08:38:58.195271 27479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.5.164.194
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43769
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.194
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:58.196619 27479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:58.198521 27479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:58.212137 27484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:58.212170 27487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:58.212159 27485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:58.216547 27479 server_base.cc:1034] running on GCE node
I20260808 08:38:58.217223 27479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:58.218235 27479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:58.219470 27479 hybrid_clock.cc:648] HybridClock initialized: now 1786178338219434 us; error 35 us; skew 500 ppm
I20260808 08:38:58.219798 27479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:38:58.222118 27479 webserver.cc:460] Webserver started at http://127.5.164.194:32911/ using document root <none> and password file <none>
I20260808 08:38:58.222828 27479 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:58.222962 27479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:58.223374 27479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:58.226270 27479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/data/instance:
uuid: "50cdad85fca34f2780871f72c44d95e0"
format_stamp: "Formatted at 2026-08-08 08:38:58 on dist-test-slave-chsk"
server_key: "913d1179ad4334790072bb107cd2bc77"
server_key_iv: "edf54bc7eb6454e73c09e5e5c728b7f9"
server_key_version: "encryptionkey@0"
I20260808 08:38:58.227067 27479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance:
uuid: "50cdad85fca34f2780871f72c44d95e0"
format_stamp: "Formatted at 2026-08-08 08:38:58 on dist-test-slave-chsk"
server_key: "913d1179ad4334790072bb107cd2bc77"
server_key_iv: "edf54bc7eb6454e73c09e5e5c728b7f9"
server_key_version: "encryptionkey@0"
I20260808 08:38:58.232123 27479 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 08:38:58.235702 27493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:58.236989 27479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 08:38:58.237174 27479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/wal
uuid: "50cdad85fca34f2780871f72c44d95e0"
format_stamp: "Formatted at 2026-08-08 08:38:58 on dist-test-slave-chsk"
server_key: "913d1179ad4334790072bb107cd2bc77"
server_key_iv: "edf54bc7eb6454e73c09e5e5c728b7f9"
server_key_version: "encryptionkey@0"
I20260808 08:38:58.237423 27479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:58.264782 27479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:58.265748 27479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:58.266073 27479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:58.267362 27479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:58.269017 27479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:58.269170 27479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:58.269323 27479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:58.269420 27479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:58.306638 27479 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.194:36807
I20260808 08:38:58.306763 27612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.194:36807 every 8 connection(s)
I20260808 08:38:58.308054 27479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/data/info.pb
I20260808 08:38:58.310248 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 27479
I20260808 08:38:58.310464 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/wal/instance
I20260808 08:38:58.311012 5779 external_mini_cluster.cc:1428] Setting key bb173b5387691e532a58913a56f8965d
I20260808 08:38:58.314289 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.5.164.195:0
--local_ip_for_outbound_sockets=127.5.164.195
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43769
--builtin_ntp_servers=127.5.164.212:38275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 08:38:58.322708 27477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:58.310620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.194:37023 (local address 127.5.164.254:43769)
0808 08:38:58.310844 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:58.310851 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:58.312515 (+ 1664us) server_negotiation.cc:407] Connection header received
0808 08:38:58.315044 (+ 2529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:58.315048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:58.315115 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:58.315245 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:58.316662 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.317388 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.319882 (+ 2494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.320276 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.320370 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:58.321975 (+ 1605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:58.321979 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:58.321982 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:58.322012 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:58.322045 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:58.322056 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:58.322126 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:58.322386 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 08:38:58.322467 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:38:58.324338 27615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:58.311303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:43769 (local address 127.5.164.194:37023)
0808 08:38:58.312338 (+ 1035us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:58.312380 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:58.314736 (+ 2356us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:58.315498 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:58.315513 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:58.315645 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:58.316478 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:58.316512 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.317549 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.317557 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:58.319744 (+ 2187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:58.319762 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.320498 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.320508 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:58.320846 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:58.321611 (+ 765us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:38:58.321617 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:58.321675 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:38:58.321786 (+ 111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:58.322155 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:58.322168 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:58.322179 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 08:38:58.322380 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 08:38:58.322845 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":321,"threads_started":1}
I20260808 08:38:58.325836 27613 heartbeater.cc:347] Connected to a master server at 127.5.164.254:43769
I20260808 08:38:58.326187 27613 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:58.327096 27613 heartbeater.cc:511] Master 127.5.164.254:43769 requested a full tablet report, sending...
I20260808 08:38:58.328645 27273 ts_manager.cc:194] Registered new tserver with Master: 50cdad85fca34f2780871f72c44d95e0 (127.5.164.194:36807)
I20260808 08:38:58.329473 27273 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.164.194:37023
W20260808 08:38:58.651298 27617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:38:58.651567 27617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:38:58.651706 27617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:38:58.658864 27617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:38:58.658962 27617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:38:58.659154 27617 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.5.164.195
I20260808 08:38:58.668504 27617 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:38275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.5.164.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.5.164.195
--webserver_port=0
--tserver_master_addrs=127.5.164.254:43769
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.5.164.195
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:38:58.669800 27617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:38:58.671624 27617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:38:58.685201 27622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:58.685329 27625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:38:58.685371 27623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:38:58.686259 27617 server_base.cc:1034] running on GCE node
I20260808 08:38:58.686856 27617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:38:58.687861 27617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:38:58.689100 27617 hybrid_clock.cc:648] HybridClock initialized: now 1786178338689052 us; error 55 us; skew 500 ppm
I20260808 08:38:58.689422 27617 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260808 08:38:58.691643 27617 webserver.cc:460] Webserver started at http://127.5.164.195:43711/ using document root <none> and password file <none>
I20260808 08:38:58.692329 27617 fs_manager.cc:359] Metadata directory not provided
I20260808 08:38:58.692461 27617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:38:58.692814 27617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:38:58.695730 27617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/data/instance:
uuid: "48cc2730ba60457685bb073dfc705a10"
format_stamp: "Formatted at 2026-08-08 08:38:58 on dist-test-slave-chsk"
server_key: "6ae86140743dcd937a54178942b44982"
server_key_iv: "aa8422f1e3e85d1f7d29d14f1054b47c"
server_key_version: "encryptionkey@0"
I20260808 08:38:58.696542 27617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance:
uuid: "48cc2730ba60457685bb073dfc705a10"
format_stamp: "Formatted at 2026-08-08 08:38:58 on dist-test-slave-chsk"
server_key: "6ae86140743dcd937a54178942b44982"
server_key_iv: "aa8422f1e3e85d1f7d29d14f1054b47c"
server_key_version: "encryptionkey@0"
I20260808 08:38:58.701679 27617 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260808 08:38:58.705199 27631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:58.706732 27617 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:38:58.706907 27617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/wal
uuid: "48cc2730ba60457685bb073dfc705a10"
format_stamp: "Formatted at 2026-08-08 08:38:58 on dist-test-slave-chsk"
server_key: "6ae86140743dcd937a54178942b44982"
server_key_iv: "aa8422f1e3e85d1f7d29d14f1054b47c"
server_key_version: "encryptionkey@0"
I20260808 08:38:58.707125 27617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:38:58.732268 27617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:38:58.733075 27617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:38:58.733474 27617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:38:58.734467 27617 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 08:38:58.735940 27617 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 08:38:58.736027 27617 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:58.736136 27617 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 08:38:58.736231 27617 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 08:38:58.769984 27617 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.195:34081
I20260808 08:38:58.770087 27751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.195:34081 every 8 connection(s)
I20260808 08:38:58.771286 27617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/data/info.pb
I20260808 08:38:58.778997 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 27617
I20260808 08:38:58.779208 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/wal/instance
I20260808 08:38:58.779681 5779 external_mini_cluster.cc:1428] Setting key 40c24b6a5e17e7b9507e3da3689e63a8
I20260808 08:38:58.784431 27477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:58.773876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.195:42945 (local address 127.5.164.254:43769)
0808 08:38:58.774065 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:58.774069 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:58.775535 (+ 1466us) server_negotiation.cc:407] Connection header received
0808 08:38:58.777479 (+ 1944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:58.777484 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:58.777578 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:58.777687 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:58.778764 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.779640 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.781484 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.781969 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.782124 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:58.783596 (+ 1472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:58.783607 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:58.783610 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:58.783628 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:58.783660 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:58.783672 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:58.783765 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:58.784005 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 08:38:58.784101 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:38:58.785362 27754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:58.774378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:43769 (local address 127.5.164.195:42945)
0808 08:38:58.775382 (+ 1004us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:58.775425 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:58.777215 (+ 1790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:58.777922 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:58.777930 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:58.778015 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:38:58.778582 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:58.778610 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.779813 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.779819 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:58.781328 (+ 1509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:58.781341 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.782213 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.782221 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:58.782508 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:58.783241 (+ 733us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 08:38:58.783244 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:38:58.783303 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 08:38:58.783412 (+ 109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:38:58.783791 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:38:58.783802 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:38:58.783809 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 08:38:58.783992 (+ 183us) client_negotiation.cc:240] Negotiation successful
0808 08:38:58.784349 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":265,"threads_started":1}
I20260808 08:38:58.786600 27752 heartbeater.cc:347] Connected to a master server at 127.5.164.254:43769
I20260808 08:38:58.786862 27752 heartbeater.cc:464] Registering TS with master...
I20260808 08:38:58.787563 27752 heartbeater.cc:511] Master 127.5.164.254:43769 requested a full tablet report, sending...
I20260808 08:38:58.788861 27273 ts_manager.cc:194] Registered new tserver with Master: 48cc2730ba60457685bb073dfc705a10 (127.5.164.195:34081)
I20260808 08:38:58.789602 27273 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.5.164.195:42945
I20260808 08:38:58.794538 5779 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 08:38:58.804152 27477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:58.798643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58786 (local address 127.5.164.254:43769)
0808 08:38:58.798824 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:58.798828 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:58.799388 (+ 560us) server_negotiation.cc:407] Connection header received
0808 08:38:58.799519 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:58.799522 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:58.799593 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:58.799677 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:58.800114 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.800771 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.801975 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.802391 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.802484 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:58.803544 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:58.803549 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:58.803553 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:58.803573 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:58.803605 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:58.803617 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:58.803698 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:58.803827 (+ 129us) server_negotiation.cc:299] Negotiation successful
0808 08:38:58.803899 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 08:38:58.807928 27273 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 08:38:58.814949 27273 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 08:38:58.842832 27768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:58.827128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52680 (local address 127.5.164.194:36807)
0808 08:38:58.832545 (+ 5417us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:58.832557 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:58.833328 (+ 771us) server_negotiation.cc:407] Connection header received
0808 08:38:58.833727 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:58.833736 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:58.833975 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:58.834162 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:58.836138 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.837454 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.840456 (+ 3002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.841620 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.841804 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:58.842075 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:58.842298 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 08:38:58.842475 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4183,"thread_start_us":4018,"threads_started":1}
I20260808 08:38:58.842932 27765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:58.826948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:36807 (local address 127.0.0.1:52680)
0808 08:38:58.833174 (+ 6226us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:58.833216 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:58.833479 (+ 263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:58.834507 (+ 1028us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:58.834514 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:58.834544 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:58.835040 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:58.835051 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.837586 (+ 2535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.837594 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:58.840217 (+ 2623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:58.840230 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.841817 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.841823 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:58.842040 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:58.842093 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 08:38:58.842243 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 08:38:58.842490 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5934,"mutex_wait_us":95,"thread_start_us":5795,"threads_started":1}
I20260808 08:38:58.844022 27766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:58.827056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:34081 (local address 127.0.0.1:57326)
0808 08:38:58.835082 (+ 8026us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:58.835103 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:58.835358 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:58.836341 (+ 983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:58.836346 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:58.836369 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:58.836790 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:58.836808 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.838403 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.838409 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:58.840534 (+ 2125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:58.840549 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.842762 (+ 2213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.842769 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:58.843357 (+ 588us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:58.843409 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 08:38:58.843495 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 08:38:58.843623 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7867,"mutex_wait_us":3,"thread_start_us":7678,"threads_started":1}
I20260808 08:38:58.844717 27769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:58.835231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37469 (local address 127.0.0.1:48950)
0808 08:38:58.835804 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:58.835826 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:58.835948 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:58.837064 (+ 1116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:58.837071 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:58.837097 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:58.837470 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:58.837486 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.839380 (+ 1894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.839386 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:58.841590 (+ 2204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:58.841606 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.843846 (+ 2240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.843852 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:58.844076 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:58.844126 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 08:38:58.844217 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 08:38:58.844355 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"mutex_wait_us":3,"thread_start_us":275,"threads_started":1}
I20260808 08:38:58.845258 27767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:58.827697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57326 (local address 127.5.164.195:34081)
0808 08:38:58.834597 (+ 6900us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:58.834606 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:58.835223 (+ 617us) server_negotiation.cc:407] Connection header received
0808 08:38:58.835597 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:58.835605 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:58.835842 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:58.836035 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:58.837007 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.838261 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.840772 (+ 2511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.842220 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.842369 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:58.842611 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:58.843564 (+ 953us) server_negotiation.cc:299] Negotiation successful
0808 08:38:58.843719 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6734,"thread_start_us":6576,"threads_started":1}
I20260808 08:38:58.845273 27770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:58.835558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48950 (local address 127.5.164.193:37469)
0808 08:38:58.836201 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:58.836211 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:58.836237 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:38:58.836334 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:58.836341 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:58.836541 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:58.836743 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:58.837660 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.839224 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.841811 (+ 2587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:58.843318 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:58.843458 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:58.843714 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:58.844613 (+ 899us) server_negotiation.cc:299] Negotiation successful
0808 08:38:58.844992 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":333,"threads_started":1}
I20260808 08:38:58.846894 27546 tablet_service.cc:1467] Processing CreateTablet for tablet b70632eac95846bca9bd79206501f323 (DEFAULT_TABLE table=test-table [id=55606a2c23ec47bf9241264a585c994a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:58.848489 27546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b70632eac95846bca9bd79206501f323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:58.848393 27403 tablet_service.cc:1467] Processing CreateTablet for tablet b70632eac95846bca9bd79206501f323 (DEFAULT_TABLE table=test-table [id=55606a2c23ec47bf9241264a585c994a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:58.848780 27685 tablet_service.cc:1467] Processing CreateTablet for tablet b70632eac95846bca9bd79206501f323 (DEFAULT_TABLE table=test-table [id=55606a2c23ec47bf9241264a585c994a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 08:38:58.849846 27403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b70632eac95846bca9bd79206501f323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:58.850108 27685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b70632eac95846bca9bd79206501f323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:38:58.850835 27475 heartbeater.cc:503] Master 127.5.164.254:43769 was elected leader, sending a full tablet report...
I20260808 08:38:58.861485 27771 tablet_bootstrap.cc:492] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f: Bootstrap starting.
I20260808 08:38:58.863850 27772 tablet_bootstrap.cc:492] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0: Bootstrap starting.
I20260808 08:38:58.865477 27773 tablet_bootstrap.cc:492] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10: Bootstrap starting.
I20260808 08:38:58.866339 27771 tablet_bootstrap.cc:654] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:58.867698 27771 log.cc:824] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:58.868053 27772 tablet_bootstrap.cc:654] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:58.868413 27773 tablet_bootstrap.cc:654] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10: Neither blocks nor log segments found. Creating new log.
I20260808 08:38:58.869321 27773 log.cc:824] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:58.869514 27772 log.cc:824] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0: Log is configured to *not* fsync() on all Append() calls
I20260808 08:38:58.872745 27773 tablet_bootstrap.cc:492] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10: No bootstrap required, opened a new log
I20260808 08:38:58.872946 27771 tablet_bootstrap.cc:492] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f: No bootstrap required, opened a new log
I20260808 08:38:58.873025 27773 ts_tablet_manager.cc:1397] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260808 08:38:58.873215 27771 ts_tablet_manager.cc:1397] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260808 08:38:58.873296 27772 tablet_bootstrap.cc:492] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0: No bootstrap required, opened a new log
I20260808 08:38:58.873543 27772 ts_tablet_manager.cc:1397] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260808 08:38:58.881115 27772 raft_consensus.cc:348] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50cdad85fca34f2780871f72c44d95e0" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36807 } } peers { permanent_uuid: "48cc2730ba60457685bb073dfc705a10" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 34081 } } peers { permanent_uuid: "4440be15e9244e70bface23879b49e8f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37469 } }
I20260808 08:38:58.881517 27772 raft_consensus.cc:374] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:58.881614 27772 raft_consensus.cc:729] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50cdad85fca34f2780871f72c44d95e0, State: Initialized, Role: FOLLOWER
I20260808 08:38:58.882395 27772 consensus_queue.cc:260] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50cdad85fca34f2780871f72c44d95e0" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36807 } } peers { permanent_uuid: "48cc2730ba60457685bb073dfc705a10" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 34081 } } peers { permanent_uuid: "4440be15e9244e70bface23879b49e8f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37469 } }
I20260808 08:38:58.884137 27613 heartbeater.cc:503] Master 127.5.164.254:43769 was elected leader, sending a full tablet report...
I20260808 08:38:58.884052 27771 raft_consensus.cc:348] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50cdad85fca34f2780871f72c44d95e0" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36807 } } peers { permanent_uuid: "48cc2730ba60457685bb073dfc705a10" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 34081 } } peers { permanent_uuid: "4440be15e9244e70bface23879b49e8f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37469 } }
I20260808 08:38:58.884511 27771 raft_consensus.cc:374] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:58.884618 27771 raft_consensus.cc:729] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4440be15e9244e70bface23879b49e8f, State: Initialized, Role: FOLLOWER
I20260808 08:38:58.884840 27772 ts_tablet_manager.cc:1428] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0: Time spent starting tablet: real 0.011s user 0.009s sys 0.002s
I20260808 08:38:58.884773 27773 raft_consensus.cc:348] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50cdad85fca34f2780871f72c44d95e0" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36807 } } peers { permanent_uuid: "48cc2730ba60457685bb073dfc705a10" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 34081 } } peers { permanent_uuid: "4440be15e9244e70bface23879b49e8f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37469 } }
I20260808 08:38:58.885304 27773 raft_consensus.cc:374] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:38:58.885435 27773 raft_consensus.cc:729] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48cc2730ba60457685bb073dfc705a10, State: Initialized, Role: FOLLOWER
I20260808 08:38:58.885285 27771 consensus_queue.cc:260] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50cdad85fca34f2780871f72c44d95e0" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36807 } } peers { permanent_uuid: "48cc2730ba60457685bb073dfc705a10" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 34081 } } peers { permanent_uuid: "4440be15e9244e70bface23879b49e8f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37469 } }
I20260808 08:38:58.886036 27773 consensus_queue.cc:260] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50cdad85fca34f2780871f72c44d95e0" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36807 } } peers { permanent_uuid: "48cc2730ba60457685bb073dfc705a10" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 34081 } } peers { permanent_uuid: "4440be15e9244e70bface23879b49e8f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37469 } }
I20260808 08:38:58.887398 27752 heartbeater.cc:503] Master 127.5.164.254:43769 was elected leader, sending a full tablet report...
I20260808 08:38:58.887964 27773 ts_tablet_manager.cc:1428] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
I20260808 08:38:58.890342 27771 ts_tablet_manager.cc:1428] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f: Time spent starting tablet: real 0.017s user 0.014s sys 0.005s
W20260808 08:38:59.023028 27753 tablet.cc:2369] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 08:38:59.060282 27614 tablet.cc:2369] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:38:59.074069 27779 raft_consensus.cc:482] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 08:38:59.074414 27779 raft_consensus.cc:504] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50cdad85fca34f2780871f72c44d95e0" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36807 } } peers { permanent_uuid: "48cc2730ba60457685bb073dfc705a10" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 34081 } } peers { permanent_uuid: "4440be15e9244e70bface23879b49e8f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37469 } }
I20260808 08:38:59.076277 27779 leader_election.cc:288] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50cdad85fca34f2780871f72c44d95e0 (127.5.164.194:36807), 48cc2730ba60457685bb073dfc705a10 (127.5.164.195:34081)
W20260808 08:38:59.078563 27476 tablet.cc:2369] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:38:59.085758 27767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:59.076870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:50265 (local address 127.5.164.195:34081)
0808 08:38:59.077102 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:59.077111 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:59.077797 (+ 686us) server_negotiation.cc:407] Connection header received
0808 08:38:59.077993 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:59.077998 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:59.078075 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:59.078176 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:59.079049 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:59.080230 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:59.083358 (+ 3128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:59.084634 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:59.084779 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:59.084844 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:59.085362 (+ 518us) server_negotiation.cc:299] Negotiation successful
0808 08:38:59.085494 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 08:38:59.085780 27768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:59.076754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.5.164.193:55597 (local address 127.5.164.194:36807)
0808 08:38:59.077224 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:59.077231 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:59.077691 (+ 460us) server_negotiation.cc:407] Connection header received
0808 08:38:59.077924 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:59.077928 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:59.078000 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:59.078094 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 08:38:59.079119 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:59.080230 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:59.083358 (+ 3128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:59.084567 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:59.084736 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:59.084807 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:59.085362 (+ 555us) server_negotiation.cc:299] Negotiation successful
0808 08:38:59.085494 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308}
I20260808 08:38:59.085927 27781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:59.076528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.194:36807 (local address 127.5.164.193:55597)
0808 08:38:59.077567 (+ 1039us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:59.077588 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:59.077777 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:59.078114 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:59.078119 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:59.078142 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:59.078916 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:59.078932 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:59.080379 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:59.080384 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:59.083068 (+ 2684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:59.083081 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:59.084832 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:59.084839 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:59.085075 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:59.085211 (+ 136us) client_negotiation.cc:769] Sending connection context
0808 08:38:59.085310 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 08:38:59.085508 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":866,"mutex_wait_us":274,"thread_start_us":502,"threads_started":1}
I20260808 08:38:59.085950 27782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:59.076774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.195:34081 (local address 127.5.164.193:50265)
0808 08:38:59.077678 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:59.077693 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:38:59.077855 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:38:59.078189 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:38:59.078194 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:38:59.078216 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 08:38:59.078851 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:59.078865 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:59.080381 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:59.080385 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:59.083067 (+ 2682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:38:59.083081 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:38:59.084841 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:38:59.084846 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:38:59.085075 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:59.085217 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 08:38:59.085310 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 08:38:59.085508 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"mutex_wait_us":308,"thread_start_us":623,"threads_started":1}
I20260808 08:38:59.087105 27566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b70632eac95846bca9bd79206501f323" candidate_uuid: "4440be15e9244e70bface23879b49e8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50cdad85fca34f2780871f72c44d95e0" is_pre_election: true
I20260808 08:38:59.087347 27706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b70632eac95846bca9bd79206501f323" candidate_uuid: "4440be15e9244e70bface23879b49e8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48cc2730ba60457685bb073dfc705a10" is_pre_election: true
I20260808 08:38:59.087786 27566 raft_consensus.cc:2454] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4440be15e9244e70bface23879b49e8f in term 0.
I20260808 08:38:59.087877 27706 raft_consensus.cc:2454] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4440be15e9244e70bface23879b49e8f in term 0.
I20260808 08:38:59.088546 27355 leader_election.cc:302] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4440be15e9244e70bface23879b49e8f, 50cdad85fca34f2780871f72c44d95e0; no voters:
I20260808 08:38:59.089000 27779 raft_consensus.cc:2781] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 08:38:59.089162 27779 raft_consensus.cc:482] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 08:38:59.089273 27779 raft_consensus.cc:3037] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:59.091571 27779 raft_consensus.cc:504] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50cdad85fca34f2780871f72c44d95e0" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36807 } } peers { permanent_uuid: "48cc2730ba60457685bb073dfc705a10" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 34081 } } peers { permanent_uuid: "4440be15e9244e70bface23879b49e8f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37469 } }
I20260808 08:38:59.092263 27779 leader_election.cc:288] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [CANDIDATE]: Term 1 election: Requested vote from peers 50cdad85fca34f2780871f72c44d95e0 (127.5.164.194:36807), 48cc2730ba60457685bb073dfc705a10 (127.5.164.195:34081)
I20260808 08:38:59.092617 27566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b70632eac95846bca9bd79206501f323" candidate_uuid: "4440be15e9244e70bface23879b49e8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50cdad85fca34f2780871f72c44d95e0"
I20260808 08:38:59.092772 27706 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b70632eac95846bca9bd79206501f323" candidate_uuid: "4440be15e9244e70bface23879b49e8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48cc2730ba60457685bb073dfc705a10"
I20260808 08:38:59.092803 27566 raft_consensus.cc:3037] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:59.092983 27706 raft_consensus.cc:3037] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:38:59.095110 27566 raft_consensus.cc:2454] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4440be15e9244e70bface23879b49e8f in term 1.
I20260808 08:38:59.095232 27706 raft_consensus.cc:2454] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4440be15e9244e70bface23879b49e8f in term 1.
I20260808 08:38:59.095685 27354 leader_election.cc:302] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4440be15e9244e70bface23879b49e8f, 48cc2730ba60457685bb073dfc705a10; no voters:
I20260808 08:38:59.095988 27779 raft_consensus.cc:2781] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:38:59.096473 27779 raft_consensus.cc:686] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [term 1 LEADER]: Becoming Leader. State: Replica: 4440be15e9244e70bface23879b49e8f, State: Running, Role: LEADER
I20260808 08:38:59.096990 27779 consensus_queue.cc:237] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50cdad85fca34f2780871f72c44d95e0" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36807 } } peers { permanent_uuid: "48cc2730ba60457685bb073dfc705a10" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 34081 } } peers { permanent_uuid: "4440be15e9244e70bface23879b49e8f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37469 } }
I20260808 08:38:59.101388 27273 catalog_manager.cc:5495] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4440be15e9244e70bface23879b49e8f (127.5.164.193). New cstate: current_term: 1 leader_uuid: "4440be15e9244e70bface23879b49e8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50cdad85fca34f2780871f72c44d95e0" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48cc2730ba60457685bb073dfc705a10" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 34081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4440be15e9244e70bface23879b49e8f" member_type: VOTER last_known_addr { host: "127.5.164.193" port: 37469 } health_report { overall_health: HEALTHY } } }
I20260808 08:38:59.140027 27770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:59.134494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48960 (local address 127.5.164.193:37469)
0808 08:38:59.134739 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:59.134747 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:59.134825 (+ 78us) server_negotiation.cc:407] Connection header received
0808 08:38:59.135072 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:59.135076 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:59.135209 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:59.135373 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:38:59.135757 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:59.136446 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:59.137851 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:59.138289 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:59.138420 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:59.138918 (+ 498us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:38:59.139446 (+ 528us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:38:59.139603 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:59.139691 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 08:38:59.139781 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 08:38:59.148561 27706 raft_consensus.cc:1261] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10 [term 1 FOLLOWER]: Refusing update from remote peer 4440be15e9244e70bface23879b49e8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:38:59.148571 27566 raft_consensus.cc:1261] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0 [term 1 FOLLOWER]: Refusing update from remote peer 4440be15e9244e70bface23879b49e8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:38:59.149545 27783 consensus_queue.cc:1035] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "48cc2730ba60457685bb073dfc705a10" member_type: VOTER last_known_addr { host: "127.5.164.195" port: 34081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:38:59.149895 27779 consensus_queue.cc:1035] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "50cdad85fca34f2780871f72c44d95e0" member_type: VOTER last_known_addr { host: "127.5.164.194" port: 36807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:38:59.161211 27786 mvcc.cc:205] Tried to move back new op lower bound from 7316186477142577152 to 7316186476944891904. Current Snapshot: MvccSnapshot[applied={T|T < 7316186477142577152}]
I20260808 08:38:59.173663 27273 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:38:59.173970 27273 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 08:38:59.177811 27273 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3f26c161306c42b4b774ecb45bebe090: Sending DeleteTablet for 3 replicas of tablet b70632eac95846bca9bd79206501f323
I20260808 08:38:59.178869 27546 tablet_service.cc:1514] Processing DeleteTablet for tablet b70632eac95846bca9bd79206501f323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:59 UTC) from {username='slave'} at 127.0.0.1:52680
I20260808 08:38:59.179075 27685 tablet_service.cc:1514] Processing DeleteTablet for tablet b70632eac95846bca9bd79206501f323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:59 UTC) from {username='slave'} at 127.0.0.1:57326
I20260808 08:38:59.179816 27403 tablet_service.cc:1514] Processing DeleteTablet for tablet b70632eac95846bca9bd79206501f323 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 08:38:59 UTC) from {username='slave'} at 127.0.0.1:48950
I20260808 08:38:59.180064 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 27337
I20260808 08:38:59.182475 27797 tablet_replica.cc:330] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f: stopping tablet replica
I20260808 08:38:59.182943 27797 raft_consensus.cc:2229] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [term 1 LEADER]: Raft consensus shutting down.
I20260808 08:38:59.183676 27797 raft_consensus.cc:2258] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:38:59.186102 27797 ts_tablet_manager.cc:1905] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:38:59.195712 27796 tablet_replica.cc:330] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10: stopping tablet replica
I20260808 08:38:59.196229 27796 raft_consensus.cc:2229] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:38:59.196667 27795 tablet_replica.cc:330] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0: stopping tablet replica
I20260808 08:38:59.196808 27796 raft_consensus.cc:2258] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:38:59.197166 27795 raft_consensus.cc:2229] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 08:38:59.197649 27795 raft_consensus.cc:2258] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 08:38:59.199081 27796 ts_tablet_manager.cc:1905] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:38:59.200001 27795 ts_tablet_manager.cc:1905] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 08:38:59.204893 27770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:59.181263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48972 (local address 127.5.164.193:37469)
0808 08:38:59.181434 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:59.181441 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:59.196003 (+ 14562us) server_negotiation.cc:407] Connection header received
0808 08:38:59.196191 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:59.196196 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:59.196325 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:59.196447 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:59.197274 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:59.198496 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:59.200526 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:59.201217 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:59.201316 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:59.202858 (+ 1542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:59.202877 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:59.202894 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:59.203716 (+ 822us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:59.203774 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:59.203807 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:59.203887 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:59.204141 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 08:38:59.204253 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:38:59.206310 27468 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:59.206634 27796 ts_tablet_manager.cc:1918] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:59.206840 27796 log.cc:1196] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-2/wal/wals/b70632eac95846bca9bd79206501f323
I20260808 08:38:59.207525 27796 ts_tablet_manager.cc:1939] T b70632eac95846bca9bd79206501f323 P 48cc2730ba60457685bb073dfc705a10: Deleting consensus metadata
I20260808 08:38:59.207998 27795 ts_tablet_manager.cc:1918] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:59.208249 27795 log.cc:1196] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-1/wal/wals/b70632eac95846bca9bd79206501f323
I20260808 08:38:59.209165 27795 ts_tablet_manager.cc:1939] T b70632eac95846bca9bd79206501f323 P 50cdad85fca34f2780871f72c44d95e0: Deleting consensus metadata
I20260808 08:38:59.209887 27258 catalog_manager.cc:4841] TS 48cc2730ba60457685bb073dfc705a10 (127.5.164.195:34081): tablet b70632eac95846bca9bd79206501f323 (table test-table [id=55606a2c23ec47bf9241264a585c994a]) successfully deleted
I20260808 08:38:59.211688 27259 catalog_manager.cc:4841] TS 50cdad85fca34f2780871f72c44d95e0 (127.5.164.194:36807): tablet b70632eac95846bca9bd79206501f323 (table test-table [id=55606a2c23ec47bf9241264a585c994a]) successfully deleted
I20260808 08:38:59.304939 27797 ts_tablet_manager.cc:1918] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 08:38:59.305274 27797 log.cc:1196] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f: Deleting WAL directory at /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786178004478096-5779-0/minicluster-data/ts-0/wal/wals/b70632eac95846bca9bd79206501f323
I20260808 08:38:59.305752 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 27337
I20260808 08:38:59.306005 27797 ts_tablet_manager.cc:1939] T b70632eac95846bca9bd79206501f323 P 4440be15e9244e70bface23879b49e8f: Deleting consensus metadata
W20260808 08:38:59.328445 27258 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.5.164.193:37469 (error 108)
I20260808 08:38:59.328554 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 27479
I20260808 08:38:59.330379 27769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:59.329846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37469 (local address 127.0.0.1:48976)
0808 08:38:59.330087 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:59.330227 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:37469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 08:38:59.330616 27258 catalog_manager.cc:4584] TS 4440be15e9244e70bface23879b49e8f (127.5.164.193:37469): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b70632eac95846bca9bd79206501f323: Network error: Client connection negotiation failed: client connection to 127.5.164.193:37469: connect: Connection refused (error 111)
I20260808 08:38:59.335851 27768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:59.329477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52688 (local address 127.5.164.194:36807)
0808 08:38:59.329642 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:59.329647 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:59.329664 (+ 17us) server_negotiation.cc:407] Connection header received
0808 08:38:59.329844 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:59.329852 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:59.329981 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:59.330092 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:59.330579 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:59.331476 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:59.332676 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:59.333061 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:59.333147 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:59.334291 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:59.334299 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:59.334311 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:59.334905 (+ 594us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:59.334948 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:59.334966 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:59.335058 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:59.335428 (+ 370us) server_negotiation.cc:299] Negotiation successful
0808 08:38:59.335512 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:38:59.336541 27608 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:59.384382 27769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:59.383870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37469 (local address 127.0.0.1:48992)
0808 08:38:59.384124 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:59.384223 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:37469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260808 08:38:59.385526 27769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:59.385152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37469 (local address 127.0.0.1:49004)
0808 08:38:59.385328 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:59.385410 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:37469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 08:38:59.426383 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 27479
I20260808 08:38:59.446403 27769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:59.445874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37469 (local address 127.0.0.1:49012)
0808 08:38:59.446110 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:59.446219 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:37469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260808 08:38:59.447615 27769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:59.447217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37469 (local address 127.0.0.1:49022)
0808 08:38:59.447375 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:59.447455 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:37469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 08:38:59.448089 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 27617
I20260808 08:38:59.455323 27767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:59.448826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57334 (local address 127.5.164.195:34081)
0808 08:38:59.449035 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:38:59.449042 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:38:59.449093 (+ 51us) server_negotiation.cc:407] Connection header received
0808 08:38:59.449328 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:38:59.449334 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:38:59.449438 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:38:59.449563 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:38:59.449979 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:59.450711 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:59.452064 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:38:59.452469 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:38:59.452617 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:38:59.453842 (+ 1225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:38:59.453852 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:38:59.453868 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:38:59.454445 (+ 577us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:38:59.454501 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:38:59.454523 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:38:59.454651 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 08:38:59.454791 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 08:38:59.454915 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 08:38:59.455991 27747 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:59.528357 27769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:59.527752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37469 (local address 127.0.0.1:49032)
0808 08:38:59.528020 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:59.528139 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:37469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260808 08:38:59.529587 27769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:38:59.529140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.193:37469 (local address 127.0.0.1:49044)
0808 08:38:59.529356 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 08:38:59.529450 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.193:37469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260808 08:38:59.547909 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 27617
I20260808 08:38:59.567569 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 27239
I20260808 08:38:59.568719 27304 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:38:59.680958 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 27239
2026-08-08T08:38:59Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2953 ms)
[----------] 6 tests from EncryptionPolicyTest (23122 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:38:59 dist-test-slave-chsk krb5kdc[27807](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:38:59 dist-test-slave-chsk krb5kdc[27807](info): set up 2 sockets
Aug 08 08:38:59 dist-test-slave-chsk krb5kdc[27807](info): commencing operation
krb5kdc: starting...
W20260808 08:39:00.880139 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.003s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:01 dist-test-slave-chsk krb5kdc[27807](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:39:01.215574 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39449
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39449
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:01.569257 27820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:01.569625 27820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:01.569821 27820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:01.577301 27820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:01.577471 27820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:01.577593 27820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:01.577709 27820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:01.577788 27820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:01.587828 27820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39449
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:01.589190 27820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:01.590554 27820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:01.602475 27827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:01.602507 27830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:01.602563 27828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:01.603710 27820 server_base.cc:1034] running on GCE node
I20260808 08:39:01.604421 27820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:01.605888 27820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:01.607210 27820 hybrid_clock.cc:648] HybridClock initialized: now 1786178341607105 us; error 49 us; skew 500 ppm
I20260808 08:39:01.607622 27820 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:01 dist-test-slave-chsk krb5kdc[27807](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178341, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:01.610817 27820 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:39:01.612459 27820 webserver.cc:460] Webserver started at http://127.0.0.1:37755/ using document root <none> and password file <none>
I20260808 08:39:01.613247 27820 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:01.613401 27820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:01.613713 27820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:01.616787 27820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "bdbf3a9a01a44c889861c37c229c3eb1"
format_stamp: "Formatted at 2026-08-08 08:39:01 on dist-test-slave-chsk"
server_key: "dd60414ad73689584254cf94e3002b70"
server_key_iv: "8bea892551fe1691b09b39ce28923d97"
server_key_version: "encryptionkey@0"
I20260808 08:39:01.617569 27820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "bdbf3a9a01a44c889861c37c229c3eb1"
format_stamp: "Formatted at 2026-08-08 08:39:01 on dist-test-slave-chsk"
server_key: "dd60414ad73689584254cf94e3002b70"
server_key_iv: "8bea892551fe1691b09b39ce28923d97"
server_key_version: "encryptionkey@0"
I20260808 08:39:01.622937 27820 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 08:39:01.626523 27838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:01.627838 27820 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:39:01.628033 27820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "bdbf3a9a01a44c889861c37c229c3eb1"
format_stamp: "Formatted at 2026-08-08 08:39:01 on dist-test-slave-chsk"
server_key: "dd60414ad73689584254cf94e3002b70"
server_key_iv: "8bea892551fe1691b09b39ce28923d97"
server_key_version: "encryptionkey@0"
I20260808 08:39:01.628238 27820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:01.651896 27820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:01.656150 27820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:01.656459 27820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:01.676170 27820 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39449
I20260808 08:39:01.676224 27891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39449 every 8 connection(s)
I20260808 08:39:01.677656 27820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:01.681471 27892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:01.686482 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 27820
I20260808 08:39:01.686725 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:01.687647 5779 external_mini_cluster.cc:1428] Setting key f74a6b60fd1ca372687ee5bec92a015a
I20260808 08:39:01.694059 27892 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1: Bootstrap starting.
I20260808 08:39:01.697885 27892 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:01.699131 27892 log.cc:824] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:01.702168 27892 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1: No bootstrap required, opened a new log
Aug 08 08:39:01 dist-test-slave-chsk krb5kdc[27807](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 08:39:01.712142 27892 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbf3a9a01a44c889861c37c229c3eb1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39449 } }
I20260808 08:39:01.712612 27892 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:01.712675 27895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:01.689742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52939 (local address 127.0.0.1:39449)
0808 08:39:01.690576 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:01.690587 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:01.690631 (+ 44us) server_negotiation.cc:407] Connection header received
0808 08:39:01.692490 (+ 1859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:01.692514 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:01.692915 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:01.693261 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:01.695296 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:01.696990 (+ 1694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:01.698779 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:01.699634 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:01.699875 (+ 241us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:01.704211 (+ 4336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:01.704221 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:01.704241 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:01.704297 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:01.708165 (+ 3868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:01.709144 (+ 979us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:01.709169 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:01.709175 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:01.709354 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:01.709858 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:01.709862 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:01.709864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:01.710395 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:01.710641 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:01.711216 (+ 575us) server_negotiation.cc:299] Negotiation successful
0808 08:39:01.711573 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":381,"threads_started":1}
I20260808 08:39:01.712765 27892 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdbf3a9a01a44c889861c37c229c3eb1, State: Initialized, Role: FOLLOWER
I20260808 08:39:01.713567 27892 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbf3a9a01a44c889861c37c229c3eb1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39449 } }
I20260808 08:39:01.713857 27892 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:01.714042 27892 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:01.714248 27892 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:01.717056 27892 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbf3a9a01a44c889861c37c229c3eb1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39449 } }
I20260808 08:39:01.717185 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:01.717564 27892 leader_election.cc:302] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdbf3a9a01a44c889861c37c229c3eb1; no voters:
I20260808 08:39:01.718184 27892 leader_election.cc:288] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:01.718325 27898 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:01.720155 27892 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:01.735394 27898 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [term 1 LEADER]: Becoming Leader. State: Replica: bdbf3a9a01a44c889861c37c229c3eb1, State: Running, Role: LEADER
I20260808 08:39:01.736747 27898 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbf3a9a01a44c889861c37c229c3eb1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39449 } }
I20260808 08:39:01.742233 27899 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdbf3a9a01a44c889861c37c229c3eb1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbf3a9a01a44c889861c37c229c3eb1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39449 } } }
I20260808 08:39:01.742714 27899 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:01.743408 27900 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdbf3a9a01a44c889861c37c229c3eb1. Latest consensus state: current_term: 1 leader_uuid: "bdbf3a9a01a44c889861c37c229c3eb1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdbf3a9a01a44c889861c37c229c3eb1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39449 } } }
I20260808 08:39:01.743803 27900 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:01.756659 27915 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:01.763353 27915 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:01.773787 27915 catalog_manager.cc:1347] Generated new cluster ID: 6a1a9c4e77bd4ce0ab281d36f9857260
I20260808 08:39:01.773907 27915 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:01.775799 27895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:01.750732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59963 (local address 127.0.0.1:39449)
0808 08:39:01.750966 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:01.750974 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:01.757457 (+ 6483us) server_negotiation.cc:407] Connection header received
0808 08:39:01.758057 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:01.758066 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:01.758173 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:01.758271 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:01.760881 (+ 2610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:01.762584 (+ 1703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:01.764752 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:01.765215 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:01.765367 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:01.768045 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:01.768050 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:01.768053 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:01.768088 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:01.771964 (+ 3876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:01.772976 (+ 1012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:01.772981 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:01.772984 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:01.773133 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:01.773741 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:01.773746 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:01.773749 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:01.774232 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:01.774514 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:01.775261 (+ 747us) server_negotiation.cc:299] Negotiation successful
0808 08:39:01.775440 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:39:01.806051 27915 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:01.807547 27915 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:01.817793 27915 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdbf3a9a01a44c889861c37c229c3eb1: Generated new TSK 0
I20260808 08:39:01.818707 27915 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:01.825181 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 27820
I20260808 08:39:01.826604 27887 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:39:01.920986 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 27820
W20260808 08:39:01.943056 27805 connection.cc:535] client connection to 127.0.0.1:39449 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39449): Connection reset by peer (error 104)
2026-08-08T08:39:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2230 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:02 dist-test-slave-chsk krb5kdc[27926](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:02 dist-test-slave-chsk krb5kdc[27926](info): set up 2 sockets
Aug 08 08:39:02 dist-test-slave-chsk krb5kdc[27926](info): commencing operation
krb5kdc: starting...
W20260808 08:39:03.095993 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.000s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:03 dist-test-slave-chsk krb5kdc[27926](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178343, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:39:03.440574 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41333
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41333
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:03.791388 27940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:03.791759 27940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:03.791872 27940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:03.798960 27940 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:03.799074 27940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:03.799121 27940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:03.799204 27940 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:03.799249 27940 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:03.809228 27940 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41333
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:03.810461 27940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:03.811813 27940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:03.823738 27946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:03.823817 27945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:03.824466 27948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:03.824460 27940 server_base.cc:1034] running on GCE node
I20260808 08:39:03.825344 27940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:03.826682 27940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:03.827878 27940 hybrid_clock.cc:648] HybridClock initialized: now 1786178343827843 us; error 30 us; skew 500 ppm
I20260808 08:39:03.828223 27940 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:03 dist-test-slave-chsk krb5kdc[27926](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178343, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:03.831519 27940 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:39:03.832973 27940 webserver.cc:460] Webserver started at http://127.0.0.1:41047/ using document root <none> and password file <none>
I20260808 08:39:03.833655 27940 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:03.833786 27940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:03.834100 27940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:03.837132 27940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "564a89f61f7541a584aa1a3e3e53a954"
format_stamp: "Formatted at 2026-08-08 08:39:03 on dist-test-slave-chsk"
server_key: "e4de598dc1367a31d3a83c8f1bd183b6"
server_key_iv: "f76a564bc303c6330e5008be2c18076d"
server_key_version: "encryptionkey@0"
I20260808 08:39:03.837904 27940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "564a89f61f7541a584aa1a3e3e53a954"
format_stamp: "Formatted at 2026-08-08 08:39:03 on dist-test-slave-chsk"
server_key: "e4de598dc1367a31d3a83c8f1bd183b6"
server_key_iv: "f76a564bc303c6330e5008be2c18076d"
server_key_version: "encryptionkey@0"
I20260808 08:39:03.843189 27940 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 08:39:03.846555 27955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:03.847824 27940 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 08:39:03.848026 27940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "564a89f61f7541a584aa1a3e3e53a954"
format_stamp: "Formatted at 2026-08-08 08:39:03 on dist-test-slave-chsk"
server_key: "e4de598dc1367a31d3a83c8f1bd183b6"
server_key_iv: "f76a564bc303c6330e5008be2c18076d"
server_key_version: "encryptionkey@0"
I20260808 08:39:03.848201 27940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:03.871130 27940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:03.875690 27940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:03.876008 27940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:03.894903 27940 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41333
I20260808 08:39:03.894937 28011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41333 every 8 connection(s)
I20260808 08:39:03.896323 27940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:03.899942 28012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:03.903913 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 27940
I20260808 08:39:03.904126 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:03.904603 5779 external_mini_cluster.cc:1428] Setting key cef473a7eb1c501bf98216a531fba99c
I20260808 08:39:03.912412 28012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954: Bootstrap starting.
I20260808 08:39:03.916074 28012 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:03.917387 28012 log.cc:824] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:03.920259 28012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954: No bootstrap required, opened a new log
I20260808 08:39:03.926039 28015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:03.906439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39567 (local address 127.0.0.1:41333)
0808 08:39:03.907289 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:03.907304 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:03.907365 (+ 61us) server_negotiation.cc:407] Connection header received
0808 08:39:03.910503 (+ 3138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:03.910530 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:03.911009 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:03.911476 (+ 467us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:03.912007 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:03.914028 (+ 2021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:03.915552 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:03.916661 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:03.916836 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:03.923024 (+ 6188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:03.923036 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:03.923059 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:03.923866 (+ 807us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:03.923969 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:03.923999 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:03.924165 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:03.924513 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 08:39:03.924704 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":582,"thread_start_us":334,"threads_started":1}
I20260808 08:39:03.929184 28012 raft_consensus.cc:348] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564a89f61f7541a584aa1a3e3e53a954" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41333 } }
I20260808 08:39:03.929556 28012 raft_consensus.cc:374] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:03.929668 28012 raft_consensus.cc:729] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 564a89f61f7541a584aa1a3e3e53a954, State: Initialized, Role: FOLLOWER
I20260808 08:39:03.930033 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:03.930334 28012 consensus_queue.cc:260] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564a89f61f7541a584aa1a3e3e53a954" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41333 } }
I20260808 08:39:03.930600 28012 raft_consensus.cc:388] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:03.930728 28012 raft_consensus.cc:482] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:03.930891 28012 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:03.934345 28012 raft_consensus.cc:504] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564a89f61f7541a584aa1a3e3e53a954" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41333 } }
I20260808 08:39:03.934957 28012 leader_election.cc:302] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 564a89f61f7541a584aa1a3e3e53a954; no voters:
I20260808 08:39:03.936244 28012 leader_election.cc:288] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:03.936343 28021 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:03.938261 28012 sys_catalog.cc:564] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:03.938797 28021 raft_consensus.cc:686] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [term 1 LEADER]: Becoming Leader. State: Replica: 564a89f61f7541a584aa1a3e3e53a954, State: Running, Role: LEADER
I20260808 08:39:03.939478 28021 consensus_queue.cc:237] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564a89f61f7541a584aa1a3e3e53a954" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41333 } }
I20260808 08:39:03.942764 28024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "564a89f61f7541a584aa1a3e3e53a954" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564a89f61f7541a584aa1a3e3e53a954" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41333 } } }
I20260808 08:39:03.943289 28024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:03.944674 28025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 564a89f61f7541a584aa1a3e3e53a954. Latest consensus state: current_term: 1 leader_uuid: "564a89f61f7541a584aa1a3e3e53a954" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "564a89f61f7541a584aa1a3e3e53a954" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41333 } } }
I20260808 08:39:03.945098 28025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:03.945739 28015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:03.935711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50199 (local address 127.0.0.1:41333)
0808 08:39:03.935942 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:03.935951 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:03.936218 (+ 267us) server_negotiation.cc:407] Connection header received
0808 08:39:03.936523 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:03.936528 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:03.936636 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:03.936747 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:03.937465 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:03.938970 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:03.941410 (+ 2440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:03.942197 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:03.942328 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:03.944257 (+ 1929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:03.944267 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:03.944275 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:03.944308 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:03.944372 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:03.944401 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:03.944551 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:03.945094 (+ 543us) server_negotiation.cc:299] Negotiation successful
0808 08:39:03.945156 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 08:39:03.948443 28030 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:03.954094 28030 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:03.962847 28030 catalog_manager.cc:1347] Generated new cluster ID: 392d64de1a95453ab9487fce6b856d1c
I20260808 08:39:03.962988 28030 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:03.979797 28030 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:03.981020 28030 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:03.987341 28030 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 564a89f61f7541a584aa1a3e3e53a954: Generated new TSK 0
I20260808 08:39:03.988114 28030 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:03.999639 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 27940
W20260808 08:39:04.001560 28005 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39567
W20260808 08:39:04.002377 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 27940: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:39:04.002579 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 27940
W20260808 08:39:04.024755 27924 connection.cc:535] client connection to 127.0.0.1:41333 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41333): Connection reset by peer (error 104)
2026-08-08T08:39:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2081 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:04 dist-test-slave-chsk krb5kdc[28044](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:04 dist-test-slave-chsk krb5kdc[28044](info): set up 2 sockets
Aug 08 08:39:04 dist-test-slave-chsk krb5kdc[28044](info): commencing operation
krb5kdc: starting...
W20260808 08:39:05.197175 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.003s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:05 dist-test-slave-chsk krb5kdc[28044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:39:05.550959 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40741
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40741
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:05.902755 28058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:05.903023 28058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:05.903254 28058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:05.910599 28058 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:05.910729 28058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:05.910842 28058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:05.910946 28058 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:05.911027 28058 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:05.921289 28058 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40741
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:05.922690 28058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:05.924137 28058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:05.936015 28064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:05.936143 28063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:05.936148 28066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:05.937134 28058 server_base.cc:1034] running on GCE node
I20260808 08:39:05.937919 28058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:05.939378 28058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:05.940667 28058 hybrid_clock.cc:648] HybridClock initialized: now 1786178345940635 us; error 29 us; skew 500 ppm
I20260808 08:39:05.941026 28058 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:05 dist-test-slave-chsk krb5kdc[28044](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178345, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:05.948585 28058 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:39:05.950232 28058 webserver.cc:460] Webserver started at http://127.0.0.1:37589/ using document root <none> and password file <none>
I20260808 08:39:05.950932 28058 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:05.951092 28058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:05.951447 28058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:05.954470 28058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "5027efacb7964428ab843af1d8c61bf9"
format_stamp: "Formatted at 2026-08-08 08:39:05 on dist-test-slave-chsk"
server_key: "ebe4eac43b379da7efc407d8ea79c206"
server_key_iv: "4224f2beed093c5c4b9ea2dad5c48a88"
server_key_version: "encryptionkey@0"
I20260808 08:39:05.955331 28058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "5027efacb7964428ab843af1d8c61bf9"
format_stamp: "Formatted at 2026-08-08 08:39:05 on dist-test-slave-chsk"
server_key: "ebe4eac43b379da7efc407d8ea79c206"
server_key_iv: "4224f2beed093c5c4b9ea2dad5c48a88"
server_key_version: "encryptionkey@0"
I20260808 08:39:05.960665 28058 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:39:05.964073 28073 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:05.965368 28058 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 08:39:05.965556 28058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "5027efacb7964428ab843af1d8c61bf9"
format_stamp: "Formatted at 2026-08-08 08:39:05 on dist-test-slave-chsk"
server_key: "ebe4eac43b379da7efc407d8ea79c206"
server_key_iv: "4224f2beed093c5c4b9ea2dad5c48a88"
server_key_version: "encryptionkey@0"
I20260808 08:39:05.965770 28058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:05.971551 28058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:05.975895 28058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:05.976202 28058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:05.995980 28058 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40741
I20260808 08:39:05.996027 28129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40741 every 8 connection(s)
I20260808 08:39:05.997397 28058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:06.001039 28130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:06.005947 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 28058
I20260808 08:39:06.006150 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:06.006759 5779 external_mini_cluster.cc:1428] Setting key c1cec0ee111db78dc5ee2df2c053e82c
I20260808 08:39:06.012954 28130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9: Bootstrap starting.
I20260808 08:39:06.014516 28133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:06.008510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42617 (local address 127.0.0.1:40741)
0808 08:39:06.009326 (+ 816us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:06.009338 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:06.009378 (+ 40us) server_negotiation.cc:407] Connection header received
0808 08:39:06.011301 (+ 1923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:06.011320 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:06.011631 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:06.011933 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:06.013033 (+ 1100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:06.013042 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:06.013056 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:06.013069 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:06.013163 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:06.013190 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:06.013353 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:06.013476 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 08:39:06.013666 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":377,"threads_started":1}
I20260808 08:39:06.016285 28130 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:06.017488 28130 log.cc:824] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:06.018113 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:06.020300 28130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9: No bootstrap required, opened a new log
I20260808 08:39:06.025141 28133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:06.022627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50095 (local address 127.0.0.1:40741)
0808 08:39:06.022830 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:06.022835 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:06.023194 (+ 359us) server_negotiation.cc:407] Connection header received
0808 08:39:06.023371 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:06.023374 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:06.023422 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:06.023501 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:06.024472 (+ 971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:06.024476 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:06.024479 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:06.024492 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:06.024544 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:06.024559 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:06.024641 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:06.024776 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 08:39:06.024819 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 08:39:06.028982 28130 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5027efacb7964428ab843af1d8c61bf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40741 } }
I20260808 08:39:06.029363 28130 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:06.029484 28130 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5027efacb7964428ab843af1d8c61bf9, State: Initialized, Role: FOLLOWER
I20260808 08:39:06.030072 28130 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5027efacb7964428ab843af1d8c61bf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40741 } }
I20260808 08:39:06.030323 28130 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:06.030475 28130 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:06.030652 28130 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:06.033205 28130 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5027efacb7964428ab843af1d8c61bf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40741 } }
I20260808 08:39:06.033653 28130 leader_election.cc:302] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5027efacb7964428ab843af1d8c61bf9; no voters:
I20260808 08:39:06.034175 28130 leader_election.cc:288] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:06.034281 28140 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:06.035115 28140 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [term 1 LEADER]: Becoming Leader. State: Replica: 5027efacb7964428ab843af1d8c61bf9, State: Running, Role: LEADER
I20260808 08:39:06.035671 28140 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5027efacb7964428ab843af1d8c61bf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40741 } }
I20260808 08:39:06.036386 28130 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:06.038537 28142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5027efacb7964428ab843af1d8c61bf9. Latest consensus state: current_term: 1 leader_uuid: "5027efacb7964428ab843af1d8c61bf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5027efacb7964428ab843af1d8c61bf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40741 } } }
I20260808 08:39:06.038506 28141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5027efacb7964428ab843af1d8c61bf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5027efacb7964428ab843af1d8c61bf9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40741 } } }
I20260808 08:39:06.039080 28142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:06.039186 28141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:06.041061 28146 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:06.045498 28146 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:06.055199 28146 catalog_manager.cc:1347] Generated new cluster ID: 816c93d205ef4b27ac7a6c6871335474
I20260808 08:39:06.055323 28146 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:06.084893 28146 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:06.085445 28146 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:06.101760 28146 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5027efacb7964428ab843af1d8c61bf9: Generated new TSK 0
I20260808 08:39:06.102857 28146 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:06.114784 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 28058
W20260808 08:39:06.116696 28123 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42617
W20260808 08:39:06.117470 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 28058: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:39:06.117642 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 28058
2026-08-08T08:39:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2114 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:06 dist-test-slave-chsk krb5kdc[28161](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:06 dist-test-slave-chsk krb5kdc[28161](info): set up 2 sockets
Aug 08 08:39:06 dist-test-slave-chsk krb5kdc[28161](info): commencing operation
krb5kdc: starting...
W20260808 08:39:07.298538 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:07 dist-test-slave-chsk krb5kdc[28161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178347, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:39:07.634912 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43785
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43785
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:07.986168 28176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:07.986469 28176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:07.986562 28176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:07.995092 28176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:07.995285 28176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:07.995345 28176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:07.995415 28176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:07.995460 28176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:08.005559 28176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43785
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:08.006875 28176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:08.008226 28176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:08.020262 28182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:08.020288 28184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:08.020493 28181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:08.021183 28176 server_base.cc:1034] running on GCE node
I20260808 08:39:08.022118 28176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:08.023610 28176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:08.024813 28176 hybrid_clock.cc:648] HybridClock initialized: now 1786178348024779 us; error 30 us; skew 500 ppm
I20260808 08:39:08.025188 28176 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:08 dist-test-slave-chsk krb5kdc[28161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178348, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:08.028316 28176 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:39:08.029819 28176 webserver.cc:460] Webserver started at http://127.0.0.1:40447/ using document root <none> and password file <none>
I20260808 08:39:08.030490 28176 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:08.030588 28176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:08.030843 28176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:08.033785 28176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "7ab6475798b74953a4c4f999d38e1be1"
format_stamp: "Formatted at 2026-08-08 08:39:08 on dist-test-slave-chsk"
server_key: "7c6dc9d7071231f2cf299311dc7c6ab3"
server_key_iv: "8e8f95f99ead31ff9945b0f634dc4f64"
server_key_version: "encryptionkey@0"
I20260808 08:39:08.034474 28176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "7ab6475798b74953a4c4f999d38e1be1"
format_stamp: "Formatted at 2026-08-08 08:39:08 on dist-test-slave-chsk"
server_key: "7c6dc9d7071231f2cf299311dc7c6ab3"
server_key_iv: "8e8f95f99ead31ff9945b0f634dc4f64"
server_key_version: "encryptionkey@0"
I20260808 08:39:08.039573 28176 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.006s
I20260808 08:39:08.043037 28191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:08.044438 28176 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:39:08.044631 28176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "7ab6475798b74953a4c4f999d38e1be1"
format_stamp: "Formatted at 2026-08-08 08:39:08 on dist-test-slave-chsk"
server_key: "7c6dc9d7071231f2cf299311dc7c6ab3"
server_key_iv: "8e8f95f99ead31ff9945b0f634dc4f64"
server_key_version: "encryptionkey@0"
I20260808 08:39:08.044840 28176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:08.062175 28176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:08.066201 28176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:08.066502 28176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:08.085721 28176 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43785
I20260808 08:39:08.085754 28245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43785 every 8 connection(s)
I20260808 08:39:08.087211 28176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:08.088513 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 28176
I20260808 08:39:08.088717 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:08.089319 5779 external_mini_cluster.cc:1428] Setting key 5647e3fd2d381bd8e503b93bf6564099
I20260808 08:39:08.091966 28246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:39:08 dist-test-slave-chsk krb5kdc[28161](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178347, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 08:39:08.104043 28246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1: Bootstrap starting.
I20260808 08:39:08.107301 28246 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:08.108382 28246 log.cc:824] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:08.111979 28246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1: No bootstrap required, opened a new log
I20260808 08:39:08.112577 28249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:08.091250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49769 (local address 127.0.0.1:43785)
0808 08:39:08.091992 (+ 742us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:08.092003 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:08.092095 (+ 92us) server_negotiation.cc:407] Connection header received
0808 08:39:08.093680 (+ 1585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:08.093701 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:08.094061 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:08.094457 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:08.095999 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:08.097331 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:08.098576 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:08.099374 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:08.099574 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:08.104628 (+ 5054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:08.104636 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:08.104650 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:08.104685 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:08.107880 (+ 3195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:08.108635 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:08.108643 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:08.108653 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:08.108866 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:08.109349 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:08.109353 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:08.109355 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:08.110006 (+ 651us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:08.110311 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:08.110733 (+ 422us) server_negotiation.cc:299] Negotiation successful
0808 08:39:08.111220 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":538,"thread_start_us":338,"threads_started":1}
I20260808 08:39:08.116585 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:08.120812 28246 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ab6475798b74953a4c4f999d38e1be1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43785 } }
I20260808 08:39:08.121470 28246 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:08.121598 28246 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab6475798b74953a4c4f999d38e1be1, State: Initialized, Role: FOLLOWER
I20260808 08:39:08.122346 28246 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ab6475798b74953a4c4f999d38e1be1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43785 } }
I20260808 08:39:08.122656 28246 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:08.122820 28246 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:08.123008 28246 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:08.125927 28246 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ab6475798b74953a4c4f999d38e1be1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43785 } }
I20260808 08:39:08.126516 28246 leader_election.cc:302] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ab6475798b74953a4c4f999d38e1be1; no voters:
I20260808 08:39:08.127297 28246 leader_election.cc:288] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:08.127393 28256 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:08.128767 28256 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [term 1 LEADER]: Becoming Leader. State: Replica: 7ab6475798b74953a4c4f999d38e1be1, State: Running, Role: LEADER
I20260808 08:39:08.129480 28256 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ab6475798b74953a4c4f999d38e1be1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43785 } }
I20260808 08:39:08.129667 28246 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:08.135192 28257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ab6475798b74953a4c4f999d38e1be1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ab6475798b74953a4c4f999d38e1be1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43785 } } }
I20260808 08:39:08.135315 28258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ab6475798b74953a4c4f999d38e1be1. Latest consensus state: current_term: 1 leader_uuid: "7ab6475798b74953a4c4f999d38e1be1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ab6475798b74953a4c4f999d38e1be1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43785 } } }
I20260808 08:39:08.135764 28258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:08.135643 28257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:08.139410 28249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:08.121218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43319 (local address 127.0.0.1:43785)
0808 08:39:08.121432 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:08.121441 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:08.121947 (+ 506us) server_negotiation.cc:407] Connection header received
0808 08:39:08.122171 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:08.122179 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:08.122260 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:08.122365 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:08.124009 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:08.125162 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:08.126456 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:08.127296 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:08.127442 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:08.130978 (+ 3536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:08.130986 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:08.130993 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:08.131040 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:08.135928 (+ 4888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:08.136908 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:08.136913 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:08.136916 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:08.137120 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:08.137654 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:08.137659 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:08.137662 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:08.138064 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:08.138365 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:08.138727 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 08:39:08.138953 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 08:39:08.141168 28264 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:08.146555 28264 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:08.161583 28264 catalog_manager.cc:1347] Generated new cluster ID: cca85b9688b74eb5943cfdb09c2d9cf5
I20260808 08:39:08.161727 28264 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:08.175625 28264 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:08.177631 28264 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:08.209004 28264 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ab6475798b74953a4c4f999d38e1be1: Generated new TSK 0
I20260808 08:39:08.209939 28264 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:08.223886 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 28176
I20260808 08:39:08.225538 28241 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:39:08.321334 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 28176
2026-08-08T08:39:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2203 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:08 dist-test-slave-chsk krb5kdc[28279](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:08 dist-test-slave-chsk krb5kdc[28279](info): set up 2 sockets
Aug 08 08:39:08 dist-test-slave-chsk krb5kdc[28279](info): commencing operation
krb5kdc: starting...
W20260808 08:39:09.487072 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:09 dist-test-slave-chsk krb5kdc[28279](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:39:09.839277 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42049
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42049
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:10.188946 28292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:10.189275 28292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:10.189445 28292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:10.196568 28292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:10.196740 28292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:10.196846 28292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:10.196955 28292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:10.197045 28292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:10.206775 28292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42049
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:10.208195 28292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:10.209549 28292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:10.221658 28297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:10.221721 28300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:10.221694 28298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:10.222498 28292 server_base.cc:1034] running on GCE node
I20260808 08:39:10.223379 28292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:10.224777 28292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:10.226014 28292 hybrid_clock.cc:648] HybridClock initialized: now 1786178350225969 us; error 57 us; skew 500 ppm
I20260808 08:39:10.226375 28292 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:10 dist-test-slave-chsk krb5kdc[28279](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178350, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:10.229635 28292 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:39:10.231132 28292 webserver.cc:460] Webserver started at http://127.0.0.1:39927/ using document root <none> and password file <none>
I20260808 08:39:10.231992 28292 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:10.232141 28292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:10.232446 28292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:10.235571 28292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "3b97e6865f804fbe8d5d69a131241156"
format_stamp: "Formatted at 2026-08-08 08:39:10 on dist-test-slave-chsk"
server_key: "2e178d371480bb12865e0e94a257a0e3"
server_key_iv: "4399ea2b2f7a5930eb37919258107f08"
server_key_version: "encryptionkey@0"
I20260808 08:39:10.236398 28292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "3b97e6865f804fbe8d5d69a131241156"
format_stamp: "Formatted at 2026-08-08 08:39:10 on dist-test-slave-chsk"
server_key: "2e178d371480bb12865e0e94a257a0e3"
server_key_iv: "4399ea2b2f7a5930eb37919258107f08"
server_key_version: "encryptionkey@0"
I20260808 08:39:10.241748 28292 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260808 08:39:10.245275 28307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:10.246641 28292 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 08:39:10.246852 28292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "3b97e6865f804fbe8d5d69a131241156"
format_stamp: "Formatted at 2026-08-08 08:39:10 on dist-test-slave-chsk"
server_key: "2e178d371480bb12865e0e94a257a0e3"
server_key_iv: "4399ea2b2f7a5930eb37919258107f08"
server_key_version: "encryptionkey@0"
I20260808 08:39:10.247067 28292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:10.260866 28292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:10.265151 28292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:10.265432 28292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:10.285868 28292 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42049
I20260808 08:39:10.285899 28361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42049 every 8 connection(s)
I20260808 08:39:10.287439 28292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:10.291352 28362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:10.293196 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 28292
I20260808 08:39:10.293396 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:10.293864 5779 external_mini_cluster.cc:1428] Setting key 043da71d3eaa9138ac7424be887d8ac9
I20260808 08:39:10.306247 28362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156: Bootstrap starting.
I20260808 08:39:10.308861 28366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:10.295765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42071 (local address 127.0.0.1:42049)
0808 08:39:10.296683 (+ 918us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:10.296699 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:10.296756 (+ 57us) server_negotiation.cc:407] Connection header received
0808 08:39:10.298447 (+ 1691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:10.298479 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:10.299011 (+ 532us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:10.299500 (+ 489us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:10.299982 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:10.301910 (+ 1928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:10.303364 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:10.304461 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:10.304647 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:10.305872 (+ 1225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:10.305885 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:10.305904 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:10.306654 (+ 750us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:10.306766 (+ 112us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:10.306799 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:10.306927 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:10.307210 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 08:39:10.307477 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":387,"threads_started":1}
I20260808 08:39:10.310505 28362 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:10.311758 28362 log.cc:824] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:10.312778 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:10.315186 28362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156: No bootstrap required, opened a new log
I20260808 08:39:10.325294 28366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:10.318448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39345 (local address 127.0.0.1:42049)
0808 08:39:10.318670 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:10.318677 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:10.319072 (+ 395us) server_negotiation.cc:407] Connection header received
0808 08:39:10.319304 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:10.319315 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:10.319404 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:10.319514 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:10.320035 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:10.321150 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:10.322521 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:10.323275 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:10.323410 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:10.324499 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:10.324506 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:10.324510 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:10.324535 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:10.324583 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:10.324603 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:10.324695 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:10.324822 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 08:39:10.324920 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 08:39:10.325472 28362 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b97e6865f804fbe8d5d69a131241156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } }
I20260808 08:39:10.325979 28362 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:10.326130 28362 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b97e6865f804fbe8d5d69a131241156, State: Initialized, Role: FOLLOWER
I20260808 08:39:10.326820 28362 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b97e6865f804fbe8d5d69a131241156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } }
I20260808 08:39:10.327112 28362 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:10.327307 28362 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:10.327493 28362 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:10.329846 28362 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b97e6865f804fbe8d5d69a131241156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } }
I20260808 08:39:10.330418 28362 leader_election.cc:302] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b97e6865f804fbe8d5d69a131241156; no voters:
I20260808 08:39:10.331110 28362 leader_election.cc:288] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:10.331369 28374 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:10.332906 28374 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [term 1 LEADER]: Becoming Leader. State: Replica: 3b97e6865f804fbe8d5d69a131241156, State: Running, Role: LEADER
I20260808 08:39:10.333604 28374 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b97e6865f804fbe8d5d69a131241156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } }
I20260808 08:39:10.333773 28362 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:10.336548 28376 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b97e6865f804fbe8d5d69a131241156. Latest consensus state: current_term: 1 leader_uuid: "3b97e6865f804fbe8d5d69a131241156" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b97e6865f804fbe8d5d69a131241156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } } }
I20260808 08:39:10.336908 28376 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:10.337595 28375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b97e6865f804fbe8d5d69a131241156" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b97e6865f804fbe8d5d69a131241156" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42049 } } }
I20260808 08:39:10.337924 28375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:10.343892 28382 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:10.350382 28382 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:10.361027 28382 catalog_manager.cc:1347] Generated new cluster ID: 41b013e5984346f6a463b33e058dfbde
I20260808 08:39:10.361187 28382 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:10.377460 28382 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:10.379591 28382 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:10.407970 28382 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b97e6865f804fbe8d5d69a131241156: Generated new TSK 0
I20260808 08:39:10.408902 28382 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:10.428558 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 28292
W20260808 08:39:10.429749 28357 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42071
W20260808 08:39:10.430680 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 28292: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:39:10.430856 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 28292
2026-08-08T08:39:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2108 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:10 dist-test-slave-chsk krb5kdc[28395](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:10 dist-test-slave-chsk krb5kdc[28395](info): set up 2 sockets
Aug 08 08:39:10 dist-test-slave-chsk krb5kdc[28395](info): commencing operation
krb5kdc: starting...
W20260808 08:39:11.616847 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:11 dist-test-slave-chsk krb5kdc[28395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178351, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:39:11.970744 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45765
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:12.318984 28408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:12.319378 28408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:12.319562 28408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:12.327003 28408 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:12.327117 28408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:12.327255 28408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:12.327374 28408 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:12.327457 28408 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:12.337870 28408 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45765
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:12.339303 28408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:12.340646 28408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:12.352756 28413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:12.352836 28414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:12.353097 28416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:12.353960 28408 server_base.cc:1034] running on GCE node
I20260808 08:39:12.354744 28408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:12.356236 28408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:12.357493 28408 hybrid_clock.cc:648] HybridClock initialized: now 1786178352357455 us; error 42 us; skew 500 ppm
I20260808 08:39:12.357870 28408 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:12 dist-test-slave-chsk krb5kdc[28395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178352, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:12.364128 28408 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:39:12.365654 28408 webserver.cc:460] Webserver started at http://127.0.0.1:37451/ using document root <none> and password file <none>
I20260808 08:39:12.366305 28408 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:12.366411 28408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:12.366657 28408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:12.369616 28408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "1889f8d1d912430daa3c45ca856cc81b"
format_stamp: "Formatted at 2026-08-08 08:39:12 on dist-test-slave-chsk"
server_key: "3b5940fc13c3e7972029637162779bae"
server_key_iv: "cd9187f2210e53766d3a665a551d8629"
server_key_version: "encryptionkey@0"
I20260808 08:39:12.370344 28408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "1889f8d1d912430daa3c45ca856cc81b"
format_stamp: "Formatted at 2026-08-08 08:39:12 on dist-test-slave-chsk"
server_key: "3b5940fc13c3e7972029637162779bae"
server_key_iv: "cd9187f2210e53766d3a665a551d8629"
server_key_version: "encryptionkey@0"
I20260808 08:39:12.375504 28408 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260808 08:39:12.378895 28424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:12.380322 28408 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:39:12.380473 28408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "1889f8d1d912430daa3c45ca856cc81b"
format_stamp: "Formatted at 2026-08-08 08:39:12 on dist-test-slave-chsk"
server_key: "3b5940fc13c3e7972029637162779bae"
server_key_iv: "cd9187f2210e53766d3a665a551d8629"
server_key_version: "encryptionkey@0"
I20260808 08:39:12.380654 28408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:12.386485 28408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:12.390345 28408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:12.390592 28408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:12.409685 28408 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45765
I20260808 08:39:12.409777 28479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45765 every 8 connection(s)
I20260808 08:39:12.411129 28408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:12.414702 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 28408
I20260808 08:39:12.414908 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:12.415081 28480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:12.415550 5779 external_mini_cluster.cc:1428] Setting key 11736ad639e9cdbd0a03495b485db184
I20260808 08:39:12.423352 28483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:12.417382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54819 (local address 127.0.0.1:45765)
0808 08:39:12.418264 (+ 882us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:12.418275 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:12.418315 (+ 40us) server_negotiation.cc:407] Connection header received
0808 08:39:12.420025 (+ 1710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:12.420045 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:12.420353 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:12.420668 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:12.421753 (+ 1085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:12.421759 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:12.421771 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:12.421792 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:12.421850 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:12.421871 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:12.422059 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:12.422158 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 08:39:12.422369 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":440,"threads_started":1}
I20260808 08:39:12.426832 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:12.429177 28480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b: Bootstrap starting.
I20260808 08:39:12.433231 28480 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:12.434662 28483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:12.432120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35485 (local address 127.0.0.1:45765)
0808 08:39:12.432341 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:12.432347 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:12.432685 (+ 338us) server_negotiation.cc:407] Connection header received
0808 08:39:12.432871 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:12.432877 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:12.432935 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:12.433010 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:12.433955 (+ 945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:12.433959 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:12.433962 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:12.433976 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:12.434013 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:12.434027 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:12.434112 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:12.434279 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 08:39:12.434326 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 08:39:12.434630 28480 log.cc:824] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:12.437554 28480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b: No bootstrap required, opened a new log
I20260808 08:39:12.444825 28480 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1889f8d1d912430daa3c45ca856cc81b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45765 } }
I20260808 08:39:12.445235 28480 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:12.445353 28480 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1889f8d1d912430daa3c45ca856cc81b, State: Initialized, Role: FOLLOWER
I20260808 08:39:12.445904 28480 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1889f8d1d912430daa3c45ca856cc81b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45765 } }
I20260808 08:39:12.446144 28480 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:12.446295 28480 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:12.446461 28480 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:12.448725 28480 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1889f8d1d912430daa3c45ca856cc81b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45765 } }
I20260808 08:39:12.449205 28480 leader_election.cc:302] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1889f8d1d912430daa3c45ca856cc81b; no voters:
I20260808 08:39:12.449755 28480 leader_election.cc:288] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:12.449891 28491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:12.450652 28491 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [term 1 LEADER]: Becoming Leader. State: Replica: 1889f8d1d912430daa3c45ca856cc81b, State: Running, Role: LEADER
I20260808 08:39:12.451313 28491 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1889f8d1d912430daa3c45ca856cc81b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45765 } }
I20260808 08:39:12.452047 28480 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:12.454089 28492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1889f8d1d912430daa3c45ca856cc81b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1889f8d1d912430daa3c45ca856cc81b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45765 } } }
I20260808 08:39:12.454562 28492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:12.453903 28493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1889f8d1d912430daa3c45ca856cc81b. Latest consensus state: current_term: 1 leader_uuid: "1889f8d1d912430daa3c45ca856cc81b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1889f8d1d912430daa3c45ca856cc81b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45765 } } }
I20260808 08:39:12.456506 28493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:12.456532 28496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:12.461884 28496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:12.471240 28496 catalog_manager.cc:1347] Generated new cluster ID: d0ac9dbb977043aab7951d4abd78da93
I20260808 08:39:12.471350 28496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:12.493278 28496 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:12.493744 28496 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:12.504038 28496 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1889f8d1d912430daa3c45ca856cc81b: Generated new TSK 0
I20260808 08:39:12.504868 28496 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:12.509830 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 28408
W20260808 08:39:12.511580 28475 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54819
W20260808 08:39:12.512383 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 28408: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:39:12.512588 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 28408
2026-08-08T08:39:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2082 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:12 dist-test-slave-chsk krb5kdc[28512](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:12 dist-test-slave-chsk krb5kdc[28512](info): set up 2 sockets
Aug 08 08:39:12 dist-test-slave-chsk krb5kdc[28512](info): commencing operation
krb5kdc: starting...
W20260808 08:39:13.687093 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.004s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:13 dist-test-slave-chsk krb5kdc[28512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:39:14.041801 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42945
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46057
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42945
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:14.402272 28527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:14.402575 28527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:14.402668 28527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:14.410001 28527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:14.410158 28527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:14.410236 28527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:14.410293 28527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:14.410338 28527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:14.420192 28527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46057
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42945
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:14.421430 28527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:14.422843 28527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:14.434612 28532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:14.434754 28535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:14.434559 28533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:14.435624 28527 server_base.cc:1034] running on GCE node
I20260808 08:39:14.436496 28527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:14.438006 28527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:14.439250 28527 hybrid_clock.cc:648] HybridClock initialized: now 1786178354439215 us; error 55 us; skew 500 ppm
I20260808 08:39:14.439615 28527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:14 dist-test-slave-chsk krb5kdc[28512](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178354, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:14.442910 28527 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:39:14.444584 28527 webserver.cc:460] Webserver started at http://127.0.0.1:33713/ using document root <none> and password file <none>
I20260808 08:39:14.445304 28527 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:14.445451 28527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:14.445765 28527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:14.448865 28527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "fa268a71942b458abd5b42372368d0ab"
format_stamp: "Formatted at 2026-08-08 08:39:14 on dist-test-slave-chsk"
server_key: "cefd97e7c1d7f70a7aed26d21ca75066"
server_key_iv: "8be5f33a961310b648027856e52da5c9"
server_key_version: "encryptionkey@0"
I20260808 08:39:14.449656 28527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "fa268a71942b458abd5b42372368d0ab"
format_stamp: "Formatted at 2026-08-08 08:39:14 on dist-test-slave-chsk"
server_key: "cefd97e7c1d7f70a7aed26d21ca75066"
server_key_iv: "8be5f33a961310b648027856e52da5c9"
server_key_version: "encryptionkey@0"
I20260808 08:39:14.454943 28527 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260808 08:39:14.458425 28542 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:14.459771 28527 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:39:14.459954 28527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "fa268a71942b458abd5b42372368d0ab"
format_stamp: "Formatted at 2026-08-08 08:39:14 on dist-test-slave-chsk"
server_key: "cefd97e7c1d7f70a7aed26d21ca75066"
server_key_iv: "8be5f33a961310b648027856e52da5c9"
server_key_version: "encryptionkey@0"
I20260808 08:39:14.460167 28527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:14.476819 28527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:14.480823 28527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:14.481118 28527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:14.500279 28527 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42945
I20260808 08:39:14.500329 28593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42945 every 8 connection(s)
I20260808 08:39:14.501652 28527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:14.505172 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 28527
I20260808 08:39:14.505234 28594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:14.505402 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:14.505889 5779 external_mini_cluster.cc:1428] Setting key e4d7bdcdebfddd2050c70cf8368d7a4c
I20260808 08:39:14.519763 28594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab: Bootstrap starting.
Aug 08 08:39:14 dist-test-slave-chsk krb5kdc[28512](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178353, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 08:39:14.522938 28594 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:14.524058 28594 log.cc:824] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:14.526935 28594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab: No bootstrap required, opened a new log
I20260808 08:39:14.529284 28597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:14.507697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:56253 (local address 127.0.0.1:42945)
0808 08:39:14.508591 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:14.508605 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:14.508655 (+ 50us) server_negotiation.cc:407] Connection header received
0808 08:39:14.510168 (+ 1513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:14.510187 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:14.510572 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:14.510966 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:14.512746 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:14.513987 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:14.515816 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:14.516496 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:14.516638 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:14.521621 (+ 4983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:14.521629 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:14.521649 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:14.521684 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:14.525032 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:14.525883 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:14.525889 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:14.525894 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:14.526048 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:14.526548 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:14.526551 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:14.526553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:14.527079 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:14.527493 (+ 414us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:14.527959 (+ 466us) server_negotiation.cc:299] Negotiation successful
0808 08:39:14.528273 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":693,"thread_start_us":470,"threads_started":1}
I20260808 08:39:14.533078 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:14.535077 28594 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa268a71942b458abd5b42372368d0ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42945 } }
I20260808 08:39:14.535504 28594 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:14.535625 28594 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa268a71942b458abd5b42372368d0ab, State: Initialized, Role: FOLLOWER
I20260808 08:39:14.536265 28594 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa268a71942b458abd5b42372368d0ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42945 } }
I20260808 08:39:14.536506 28594 raft_consensus.cc:388] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:14.536671 28594 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:14.536844 28594 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:14.539729 28594 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa268a71942b458abd5b42372368d0ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42945 } }
I20260808 08:39:14.540256 28594 leader_election.cc:302] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa268a71942b458abd5b42372368d0ab; no voters:
I20260808 08:39:14.540927 28594 leader_election.cc:288] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:14.541062 28604 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:14.541752 28604 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [term 1 LEADER]: Becoming Leader. State: Replica: fa268a71942b458abd5b42372368d0ab, State: Running, Role: LEADER
I20260808 08:39:14.542389 28604 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa268a71942b458abd5b42372368d0ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42945 } }
I20260808 08:39:14.545228 28594 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:14.545280 28606 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa268a71942b458abd5b42372368d0ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa268a71942b458abd5b42372368d0ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42945 } } }
I20260808 08:39:14.545707 28606 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:14.550380 28605 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa268a71942b458abd5b42372368d0ab. Latest consensus state: current_term: 1 leader_uuid: "fa268a71942b458abd5b42372368d0ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa268a71942b458abd5b42372368d0ab" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42945 } } }
I20260808 08:39:14.550803 28605 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:14.551559 28608 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:14.557672 28597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:14.537767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:37527 (local address 127.0.0.1:42945)
0808 08:39:14.537971 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:14.537977 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:14.538423 (+ 446us) server_negotiation.cc:407] Connection header received
0808 08:39:14.538537 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:14.538543 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:14.538634 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:14.538740 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:14.540226 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:14.541479 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:14.543800 (+ 2321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:14.544615 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:14.548534 (+ 3919us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:14.548866 (+ 332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:14.548875 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:14.548879 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:14.548920 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:14.553185 (+ 4265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:14.554465 (+ 1280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:14.554469 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:14.554472 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:14.554620 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:14.555276 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:14.555286 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:14.555289 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:14.555686 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:14.556945 (+ 1259us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:14.557124 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 08:39:14.557314 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:39:14.558257 28608 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:14.567916 28608 catalog_manager.cc:1347] Generated new cluster ID: 3618ccfe42dc445bb98f513f04d876d0
I20260808 08:39:14.568048 28608 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:14.592456 28608 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:14.594355 28608 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:14.607038 28608 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fa268a71942b458abd5b42372368d0ab: Generated new TSK 0
I20260808 08:39:14.608142 28608 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:14.615947 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 28527
I20260808 08:39:14.617159 28589 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:39:14.709707 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 28527
W20260808 08:39:14.731400 28510 connection.cc:535] client connection to 127.0.0.1:42945 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42945): Connection reset by peer (error 104)
2026-08-08T08:39:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2196 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:14 dist-test-slave-chsk krb5kdc[28628](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:14 dist-test-slave-chsk krb5kdc[28628](info): set up 2 sockets
Aug 08 08:39:14 dist-test-slave-chsk krb5kdc[28628](info): commencing operation
krb5kdc: starting...
W20260808 08:39:15.884092 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.003s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:16 dist-test-slave-chsk krb5kdc[28628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178356, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:39:16.230700 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44949
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41175
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44949
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:16.586154 28641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:16.586516 28641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:16.586684 28641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:16.594702 28641 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:16.594869 28641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:16.594980 28641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:16.595077 28641 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:16.595181 28641 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:16.605520 28641 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41175
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:16.606917 28641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:16.608382 28641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:16.620718 28646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:16.620674 28649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:16.620754 28647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:16.621681 28641 server_base.cc:1034] running on GCE node
I20260808 08:39:16.622612 28641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:16.624130 28641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:16.625342 28641 hybrid_clock.cc:648] HybridClock initialized: now 1786178356625303 us; error 31 us; skew 500 ppm
I20260808 08:39:16.625692 28641 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:16 dist-test-slave-chsk krb5kdc[28628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178356, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:16.629009 28641 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:39:16.630671 28641 webserver.cc:460] Webserver started at http://127.0.0.1:38425/ using document root <none> and password file <none>
I20260808 08:39:16.631480 28641 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:16.631623 28641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:16.631955 28641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:16.635023 28641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "4720e3f4c7f442938ef05726eb16b8d6"
format_stamp: "Formatted at 2026-08-08 08:39:16 on dist-test-slave-chsk"
server_key: "667989cfd4d9d8e5497b941035209577"
server_key_iv: "a1c91d6b24a3ed18640aa0cb0a7a9cda"
server_key_version: "encryptionkey@0"
I20260808 08:39:16.635919 28641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "4720e3f4c7f442938ef05726eb16b8d6"
format_stamp: "Formatted at 2026-08-08 08:39:16 on dist-test-slave-chsk"
server_key: "667989cfd4d9d8e5497b941035209577"
server_key_iv: "a1c91d6b24a3ed18640aa0cb0a7a9cda"
server_key_version: "encryptionkey@0"
I20260808 08:39:16.641842 28641 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260808 08:39:16.645586 28656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:16.646924 28641 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 08:39:16.647137 28641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "4720e3f4c7f442938ef05726eb16b8d6"
format_stamp: "Formatted at 2026-08-08 08:39:16 on dist-test-slave-chsk"
server_key: "667989cfd4d9d8e5497b941035209577"
server_key_iv: "a1c91d6b24a3ed18640aa0cb0a7a9cda"
server_key_version: "encryptionkey@0"
I20260808 08:39:16.647485 28641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:16.669261 28641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:16.673445 28641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:16.673756 28641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:16.693226 28641 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44949
I20260808 08:39:16.693275 28712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44949 every 8 connection(s)
I20260808 08:39:16.694597 28641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:16.696767 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 28641
I20260808 08:39:16.696959 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:16.697417 5779 external_mini_cluster.cc:1428] Setting key 4c53a3e5fef3f2cf6351be3a1f0abf5d
I20260808 08:39:16.698675 28713 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:16.710588 28716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:16.699198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:59409 (local address 127.0.0.1:44949)
0808 08:39:16.699967 (+ 769us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:16.699978 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:16.700017 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:39:16.701624 (+ 1607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:16.701643 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:16.702020 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:16.702340 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:16.702936 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:16.704300 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:16.706215 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:16.706844 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:16.706962 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:16.708338 (+ 1376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:16.708345 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:16.708356 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:16.708877 (+ 521us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:16.708950 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:16.708976 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:16.709089 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:16.709400 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 08:39:16.709613 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":361,"threads_started":1}
I20260808 08:39:16.712379 28713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6: Bootstrap starting.
I20260808 08:39:16.714432 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:16.715771 28713 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:16.716771 28713 log.cc:824] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:16.719869 28713 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6: No bootstrap required, opened a new log
I20260808 08:39:16.725807 28716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:16.718983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:49935 (local address 127.0.0.1:44949)
0808 08:39:16.719200 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:16.719206 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:16.719722 (+ 516us) server_negotiation.cc:407] Connection header received
0808 08:39:16.719875 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:16.719882 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:16.719966 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:16.720070 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:16.720557 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:16.721691 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:16.723042 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:16.723775 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:16.723921 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:16.724996 (+ 1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:16.725004 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:16.725009 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:16.725030 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:16.725081 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:16.725102 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:16.725227 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:16.725400 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 08:39:16.725458 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 08:39:16.730059 28713 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4720e3f4c7f442938ef05726eb16b8d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44949 } }
I20260808 08:39:16.730412 28713 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:16.730484 28713 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4720e3f4c7f442938ef05726eb16b8d6, State: Initialized, Role: FOLLOWER
I20260808 08:39:16.730966 28713 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4720e3f4c7f442938ef05726eb16b8d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44949 } }
I20260808 08:39:16.731280 28713 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:16.731391 28713 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:16.731519 28713 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:16.733623 28713 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4720e3f4c7f442938ef05726eb16b8d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44949 } }
I20260808 08:39:16.734119 28713 leader_election.cc:302] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4720e3f4c7f442938ef05726eb16b8d6; no voters:
I20260808 08:39:16.734670 28713 leader_election.cc:288] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:16.734824 28723 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:16.735453 28723 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [term 1 LEADER]: Becoming Leader. State: Replica: 4720e3f4c7f442938ef05726eb16b8d6, State: Running, Role: LEADER
I20260808 08:39:16.736027 28723 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4720e3f4c7f442938ef05726eb16b8d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44949 } }
I20260808 08:39:16.737857 28724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4720e3f4c7f442938ef05726eb16b8d6. Latest consensus state: current_term: 1 leader_uuid: "4720e3f4c7f442938ef05726eb16b8d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4720e3f4c7f442938ef05726eb16b8d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44949 } } }
I20260808 08:39:16.738277 28724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:16.738308 28713 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:16.738842 28725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4720e3f4c7f442938ef05726eb16b8d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4720e3f4c7f442938ef05726eb16b8d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44949 } } }
I20260808 08:39:16.739169 28725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:16.739857 28727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:16.746765 28727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:16.755185 28727 catalog_manager.cc:1347] Generated new cluster ID: 373134994bc04c4bb34e97c4fad6302d
I20260808 08:39:16.755312 28727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:16.767849 28727 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:16.769623 28727 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:16.776721 28727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4720e3f4c7f442938ef05726eb16b8d6: Generated new TSK 0
I20260808 08:39:16.777515 28727 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:16.785713 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 28641
W20260808 08:39:16.786841 28708 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.110:59409
W20260808 08:39:16.787796 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 28641: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:39:16.787949 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 28641
W20260808 08:39:16.809278 28626 connection.cc:535] client connection to 127.0.0.1:44949 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44949): Connection reset by peer (error 104)
2026-08-08T08:39:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2078 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:16 dist-test-slave-chsk krb5kdc[28745](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:16 dist-test-slave-chsk krb5kdc[28745](info): set up 2 sockets
Aug 08 08:39:16 dist-test-slave-chsk krb5kdc[28745](info): commencing operation
krb5kdc: starting...
W20260808 08:39:17.972502 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.006s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:18 dist-test-slave-chsk krb5kdc[28745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178358, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:39:18.316761 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38467
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38467
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:18.662496 28758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:18.662784 28758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:18.662964 28758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:18.670341 28758 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:18.670495 28758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:18.670614 28758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:18.670715 28758 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:18.670799 28758 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:18.680749 28758 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38467
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:18.682063 28758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:18.683424 28758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:18.695256 28763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:18.695291 28764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:18.695343 28767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:18.696074 28758 server_base.cc:1034] running on GCE node
I20260808 08:39:18.696928 28758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:18.698361 28758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:18.699581 28758 hybrid_clock.cc:648] HybridClock initialized: now 1786178358699538 us; error 38 us; skew 500 ppm
I20260808 08:39:18.699934 28758 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:18 dist-test-slave-chsk krb5kdc[28745](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178358, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:18.707525 28758 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:39:18.709096 28758 webserver.cc:460] Webserver started at http://127.0.0.1:44831/ using document root <none> and password file <none>
I20260808 08:39:18.709801 28758 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:18.709947 28758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:18.710274 28758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:18.713294 28758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "3a60b9c5a24443128dc1cbe707af0e5d"
format_stamp: "Formatted at 2026-08-08 08:39:18 on dist-test-slave-chsk"
server_key: "04517fe10209bd7ba24c6b141f5b3927"
server_key_iv: "2478a3a76824f9535d5696f0710d63ce"
server_key_version: "encryptionkey@0"
I20260808 08:39:18.714078 28758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "3a60b9c5a24443128dc1cbe707af0e5d"
format_stamp: "Formatted at 2026-08-08 08:39:18 on dist-test-slave-chsk"
server_key: "04517fe10209bd7ba24c6b141f5b3927"
server_key_iv: "2478a3a76824f9535d5696f0710d63ce"
server_key_version: "encryptionkey@0"
I20260808 08:39:18.719375 28758 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260808 08:39:18.722718 28775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:18.723986 28758 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:39:18.724181 28758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "3a60b9c5a24443128dc1cbe707af0e5d"
format_stamp: "Formatted at 2026-08-08 08:39:18 on dist-test-slave-chsk"
server_key: "04517fe10209bd7ba24c6b141f5b3927"
server_key_iv: "2478a3a76824f9535d5696f0710d63ce"
server_key_version: "encryptionkey@0"
I20260808 08:39:18.724376 28758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:18.730005 28758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:18.733889 28758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:18.734185 28758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:18.752599 28758 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38467
I20260808 08:39:18.752635 28829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38467 every 8 connection(s)
I20260808 08:39:18.753971 28758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:18.757553 28830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:18.759959 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 28758
I20260808 08:39:18.760144 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:18.760601 5779 external_mini_cluster.cc:1428] Setting key 2e7b55cb282397518866413e3571130d
I20260808 08:39:18.768177 28834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:18.762341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:57807 (local address 127.0.0.1:38467)
0808 08:39:18.763189 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:18.763213 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:18.763256 (+ 43us) server_negotiation.cc:407] Connection header received
0808 08:39:18.764890 (+ 1634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:18.764911 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:18.765231 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:18.765548 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:18.766651 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:18.766657 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:18.766668 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:18.766682 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:18.766746 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:18.766787 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:18.766960 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:18.767070 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 08:39:18.767314 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":384,"threads_started":1}
I20260808 08:39:18.769387 28830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d: Bootstrap starting.
I20260808 08:39:18.771768 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:18.772706 28830 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:18.773730 28830 log.cc:824] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:18.777031 28830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d: No bootstrap required, opened a new log
I20260808 08:39:18.778903 28834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:18.776373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:53903 (local address 127.0.0.1:38467)
0808 08:39:18.776597 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:18.776604 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:18.777001 (+ 397us) server_negotiation.cc:407] Connection header received
0808 08:39:18.777207 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:18.777211 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:18.777256 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:18.777333 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:18.778272 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:18.778276 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:18.778279 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:18.778296 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:18.778332 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:18.778346 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:18.778431 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:18.778572 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 08:39:18.778618 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:39:18.785247 28830 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a60b9c5a24443128dc1cbe707af0e5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38467 } }
I20260808 08:39:18.785640 28830 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:18.785755 28830 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a60b9c5a24443128dc1cbe707af0e5d, State: Initialized, Role: FOLLOWER
I20260808 08:39:18.786300 28830 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a60b9c5a24443128dc1cbe707af0e5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38467 } }
I20260808 08:39:18.786550 28830 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:18.786695 28830 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:18.786893 28830 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:18.789175 28830 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a60b9c5a24443128dc1cbe707af0e5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38467 } }
I20260808 08:39:18.789659 28830 leader_election.cc:302] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a60b9c5a24443128dc1cbe707af0e5d; no voters:
I20260808 08:39:18.790283 28830 leader_election.cc:288] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:18.790431 28841 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:18.791113 28841 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [term 1 LEADER]: Becoming Leader. State: Replica: 3a60b9c5a24443128dc1cbe707af0e5d, State: Running, Role: LEADER
I20260808 08:39:18.791709 28841 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a60b9c5a24443128dc1cbe707af0e5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38467 } }
I20260808 08:39:18.792418 28830 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:18.794854 28842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a60b9c5a24443128dc1cbe707af0e5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a60b9c5a24443128dc1cbe707af0e5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38467 } } }
I20260808 08:39:18.794783 28843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a60b9c5a24443128dc1cbe707af0e5d. Latest consensus state: current_term: 1 leader_uuid: "3a60b9c5a24443128dc1cbe707af0e5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a60b9c5a24443128dc1cbe707af0e5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38467 } } }
I20260808 08:39:18.795416 28843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:18.795416 28842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:18.806744 28849 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:18.813611 28849 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:18.822326 28849 catalog_manager.cc:1347] Generated new cluster ID: ce679da37b3844689eb440cdb02d4f55
I20260808 08:39:18.822453 28849 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:18.841240 28849 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:18.841696 28849 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:18.863302 28849 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a60b9c5a24443128dc1cbe707af0e5d: Generated new TSK 0
I20260808 08:39:18.864162 28849 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:18.877848 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 28758
W20260808 08:39:18.879106 28824 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.110:57807
W20260808 08:39:18.879958 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 28758: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:39:18.880097 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 28758
2026-08-08T08:39:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2092 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:19 dist-test-slave-chsk krb5kdc[28863](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:19 dist-test-slave-chsk krb5kdc[28863](info): set up 2 sockets
Aug 08 08:39:19 dist-test-slave-chsk krb5kdc[28863](info): commencing operation
krb5kdc: starting...
W20260808 08:39:20.064332 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:20 dist-test-slave-chsk krb5kdc[28863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:39:20.392258 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41873
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41873
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:20.733871 28876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:20.734171 28876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:20.734349 28876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:20.741770 28876 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:20.741889 28876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:20.742038 28876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:20.742131 28876 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:20.742213 28876 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:20.752823 28876 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41873
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:20.754201 28876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:20.755582 28876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:20.767436 28882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:20.767501 28884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:20.767522 28881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:20.768489 28876 server_base.cc:1034] running on GCE node
I20260808 08:39:20.769259 28876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:20.770622 28876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:20.771836 28876 hybrid_clock.cc:648] HybridClock initialized: now 1786178360771789 us; error 34 us; skew 500 ppm
I20260808 08:39:20.772149 28876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:20 dist-test-slave-chsk krb5kdc[28863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178360, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:20.775354 28876 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:39:20.776733 28876 webserver.cc:460] Webserver started at http://127.0.0.1:35249/ using document root <none> and password file <none>
I20260808 08:39:20.777372 28876 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:20.777478 28876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:20.777733 28876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:20.780689 28876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "2d427c8fbf904de49f1bec3718a7aae0"
format_stamp: "Formatted at 2026-08-08 08:39:20 on dist-test-slave-chsk"
server_key: "611d29c1c6c9098340fdda53845de3a2"
server_key_iv: "5c5a6bf7dd59c3f98dfad66163fe63c2"
server_key_version: "encryptionkey@0"
I20260808 08:39:20.781422 28876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "2d427c8fbf904de49f1bec3718a7aae0"
format_stamp: "Formatted at 2026-08-08 08:39:20 on dist-test-slave-chsk"
server_key: "611d29c1c6c9098340fdda53845de3a2"
server_key_iv: "5c5a6bf7dd59c3f98dfad66163fe63c2"
server_key_version: "encryptionkey@0"
I20260808 08:39:20.786520 28876 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260808 08:39:20.790153 28891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:20.791702 28876 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:39:20.791891 28876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "2d427c8fbf904de49f1bec3718a7aae0"
format_stamp: "Formatted at 2026-08-08 08:39:20 on dist-test-slave-chsk"
server_key: "611d29c1c6c9098340fdda53845de3a2"
server_key_iv: "5c5a6bf7dd59c3f98dfad66163fe63c2"
server_key_version: "encryptionkey@0"
I20260808 08:39:20.792109 28876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:20.815342 28876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:20.819768 28876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:20.820031 28876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:20.839664 28876 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41873
I20260808 08:39:20.839684 28945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41873 every 8 connection(s)
I20260808 08:39:20.841079 28876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:20.844465 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 28876
I20260808 08:39:20.844666 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:20.844976 28946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:20.845180 5779 external_mini_cluster.cc:1428] Setting key 4b3703ebece323a96ad7f079ae77c988
I20260808 08:39:20.857949 28946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0: Bootstrap starting.
Aug 08 08:39:20 dist-test-slave-chsk krb5kdc[28863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 08:39:20.861352 28946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:20.862555 28946 log.cc:824] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:20.865409 28946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0: No bootstrap required, opened a new log
I20260808 08:39:20.867576 28949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:20.846971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:34769 (local address 127.0.0.1:41873)
0808 08:39:20.847751 (+ 780us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:20.847763 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:20.847806 (+ 43us) server_negotiation.cc:407] Connection header received
0808 08:39:20.849695 (+ 1889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:20.849717 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:20.850107 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:20.850481 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:20.852018 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:20.853404 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:20.854688 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:20.855449 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:20.855669 (+ 220us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:20.860152 (+ 4483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:20.860160 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:20.860172 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:20.860212 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:20.863463 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:20.864234 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:20.864240 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:20.864246 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:20.864408 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:20.864881 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:20.864884 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:20.864887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:20.865369 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:20.865693 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:20.866254 (+ 561us) server_negotiation.cc:299] Negotiation successful
0808 08:39:20.866550 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":339,"threads_started":1}
I20260808 08:39:20.871289 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:20.873422 28946 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d427c8fbf904de49f1bec3718a7aae0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41873 } }
I20260808 08:39:20.873915 28946 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:20.874030 28946 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d427c8fbf904de49f1bec3718a7aae0, State: Initialized, Role: FOLLOWER
I20260808 08:39:20.874729 28946 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d427c8fbf904de49f1bec3718a7aae0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41873 } }
I20260808 08:39:20.874965 28946 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:20.875124 28946 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:20.875371 28946 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:20.877909 28946 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d427c8fbf904de49f1bec3718a7aae0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41873 } }
I20260808 08:39:20.878440 28946 leader_election.cc:302] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d427c8fbf904de49f1bec3718a7aae0; no voters:
I20260808 08:39:20.879158 28946 leader_election.cc:288] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:20.879294 28956 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:20.881814 28946 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:20.887583 28956 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [term 1 LEADER]: Becoming Leader. State: Replica: 2d427c8fbf904de49f1bec3718a7aae0, State: Running, Role: LEADER
I20260808 08:39:20.888387 28956 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d427c8fbf904de49f1bec3718a7aae0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41873 } }
I20260808 08:39:20.892316 28957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d427c8fbf904de49f1bec3718a7aae0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d427c8fbf904de49f1bec3718a7aae0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41873 } } }
I20260808 08:39:20.892813 28957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:20.893483 28958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d427c8fbf904de49f1bec3718a7aae0. Latest consensus state: current_term: 1 leader_uuid: "2d427c8fbf904de49f1bec3718a7aae0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d427c8fbf904de49f1bec3718a7aae0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41873 } } }
I20260808 08:39:20.894048 28958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:20.894553 28949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:20.875556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:46905 (local address 127.0.0.1:41873)
0808 08:39:20.875748 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:20.875756 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:20.876295 (+ 539us) server_negotiation.cc:407] Connection header received
0808 08:39:20.876408 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:20.876413 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:20.876497 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:20.876627 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:20.878124 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:20.878967 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:20.880683 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:20.881212 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:20.881337 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:20.883978 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:20.883985 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:20.883990 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:20.884032 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:20.889875 (+ 5843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:20.890969 (+ 1094us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:20.890974 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:20.890978 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:20.891128 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:20.891788 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:20.891796 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:20.891801 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:20.892409 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:20.892787 (+ 378us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:20.893730 (+ 943us) server_negotiation.cc:299] Negotiation successful
0808 08:39:20.893996 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:39:20.900286 28967 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:20.906111 28967 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:20.915580 28967 catalog_manager.cc:1347] Generated new cluster ID: c4fd237d7cca4e15ada6b14fff9a4d39
I20260808 08:39:20.915722 28967 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:20.934099 28967 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:20.935487 28967 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:20.943804 28967 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d427c8fbf904de49f1bec3718a7aae0: Generated new TSK 0
I20260808 08:39:20.944561 28967 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:20.952241 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 28876
I20260808 08:39:20.953421 28941 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:39:21.046661 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 28876
W20260808 08:39:21.067870 28861 connection.cc:535] client connection to 127.0.0.1:41873 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41873): Connection reset by peer (error 104)
2026-08-08T08:39:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2165 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:21 dist-test-slave-chsk krb5kdc[28980](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:21 dist-test-slave-chsk krb5kdc[28980](info): set up 2 sockets
Aug 08 08:39:21 dist-test-slave-chsk krb5kdc[28980](info): commencing operation
krb5kdc: starting...
W20260808 08:39:22.220084 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:22 dist-test-slave-chsk krb5kdc[28980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178362, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:39:22.560010 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34627
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34627
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:22.902606 28994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:22.902954 28994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:22.903168 28994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:22.910368 28994 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:22.910521 28994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:22.910610 28994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:22.910691 28994 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:22.910777 28994 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:22.920706 28994 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34627
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:22.922128 28994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:22.923595 28994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:22.936074 28999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:22.935963 29000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:22.936009 29002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:22.937198 28994 server_base.cc:1034] running on GCE node
I20260808 08:39:22.937994 28994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:22.939443 28994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:22.940657 28994 hybrid_clock.cc:648] HybridClock initialized: now 1786178362940616 us; error 40 us; skew 500 ppm
I20260808 08:39:22.940989 28994 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:22 dist-test-slave-chsk krb5kdc[28980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178362, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:22.944170 28994 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:39:22.945566 28994 webserver.cc:460] Webserver started at http://127.0.0.1:46721/ using document root <none> and password file <none>
I20260808 08:39:22.946233 28994 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:22.946393 28994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:22.946692 28994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:22.949651 28994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "7726a1f20d9046b3bff2bc06c1d0b636"
format_stamp: "Formatted at 2026-08-08 08:39:22 on dist-test-slave-chsk"
server_key: "9653a247389d502d34bcc1d77a65fd48"
server_key_iv: "4352a425bea16fccc385a9ad42ec7ac3"
server_key_version: "encryptionkey@0"
I20260808 08:39:22.950429 28994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "7726a1f20d9046b3bff2bc06c1d0b636"
format_stamp: "Formatted at 2026-08-08 08:39:22 on dist-test-slave-chsk"
server_key: "9653a247389d502d34bcc1d77a65fd48"
server_key_iv: "4352a425bea16fccc385a9ad42ec7ac3"
server_key_version: "encryptionkey@0"
I20260808 08:39:22.955363 28994 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260808 08:39:22.958688 29010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:22.960047 28994 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:39:22.960220 28994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "7726a1f20d9046b3bff2bc06c1d0b636"
format_stamp: "Formatted at 2026-08-08 08:39:22 on dist-test-slave-chsk"
server_key: "9653a247389d502d34bcc1d77a65fd48"
server_key_iv: "4352a425bea16fccc385a9ad42ec7ac3"
server_key_version: "encryptionkey@0"
I20260808 08:39:22.960407 28994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:22.974785 28994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:22.978679 28994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:22.978956 28994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:22.997824 28994 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34627
I20260808 08:39:22.997869 29062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34627 every 8 connection(s)
I20260808 08:39:22.999276 28994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:23.003132 29063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:23.003499 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 28994
I20260808 08:39:23.003710 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:23.010356 5779 external_mini_cluster.cc:1428] Setting key bc79886d12b77a071e96ebfd504fd762
I20260808 08:39:23.018733 29063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636: Bootstrap starting.
I20260808 08:39:23.022459 29063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:23.023648 29063 log.cc:824] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:23.024001 29066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:23.012265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:60541 (local address 127.0.0.1:34627)
0808 08:39:23.013041 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:23.013053 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:23.013095 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:39:23.014751 (+ 1656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:23.014774 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:23.015244 (+ 470us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:23.015567 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:23.016200 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:23.017567 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:23.019418 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:23.020069 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:23.020206 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:23.021573 (+ 1367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:23.021580 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:23.021592 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:23.022127 (+ 535us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:23.022212 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:23.022236 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:23.022355 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:23.022750 (+ 395us) server_negotiation.cc:299] Negotiation successful
0808 08:39:23.022948 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":361,"threads_started":1}
I20260808 08:39:23.026525 29063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636: No bootstrap required, opened a new log
I20260808 08:39:23.027817 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:23.036156 29063 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7726a1f20d9046b3bff2bc06c1d0b636" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34627 } }
I20260808 08:39:23.036533 29063 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:23.036664 29063 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7726a1f20d9046b3bff2bc06c1d0b636, State: Initialized, Role: FOLLOWER
I20260808 08:39:23.037344 29063 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7726a1f20d9046b3bff2bc06c1d0b636" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34627 } }
I20260808 08:39:23.037657 29063 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:23.037818 29063 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:23.038012 29063 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:23.041115 29063 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7726a1f20d9046b3bff2bc06c1d0b636" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34627 } }
I20260808 08:39:23.041692 29063 leader_election.cc:302] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7726a1f20d9046b3bff2bc06c1d0b636; no voters:
I20260808 08:39:23.042608 29063 leader_election.cc:288] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:23.042711 29073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:23.044047 29066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:23.033362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:39043 (local address 127.0.0.1:34627)
0808 08:39:23.033559 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:23.033570 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:23.037093 (+ 3523us) server_negotiation.cc:407] Connection header received
0808 08:39:23.037276 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:23.037279 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:23.037345 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:23.037429 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:23.038078 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:23.038922 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:23.040835 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:23.041395 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:23.041490 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:23.042793 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:23.042802 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:23.042809 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:23.042833 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:23.042887 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:23.042909 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:23.043066 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:23.043482 (+ 416us) server_negotiation.cc:299] Negotiation successful
0808 08:39:23.043555 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 08:39:23.045169 29063 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:23.045096 29073 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [term 1 LEADER]: Becoming Leader. State: Replica: 7726a1f20d9046b3bff2bc06c1d0b636, State: Running, Role: LEADER
I20260808 08:39:23.046635 29073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7726a1f20d9046b3bff2bc06c1d0b636" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34627 } }
I20260808 08:39:23.053145 29075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7726a1f20d9046b3bff2bc06c1d0b636. Latest consensus state: current_term: 1 leader_uuid: "7726a1f20d9046b3bff2bc06c1d0b636" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7726a1f20d9046b3bff2bc06c1d0b636" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34627 } } }
I20260808 08:39:23.053484 29075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:23.052517 29074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7726a1f20d9046b3bff2bc06c1d0b636" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7726a1f20d9046b3bff2bc06c1d0b636" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34627 } } }
I20260808 08:39:23.053789 29074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636 [sys.catalog]: This master's current role is: LEADER
W20260808 08:39:23.064108 29087 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:39:23.064209 29087 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:39:23.064369 29088 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:23.066095 29088 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:23.073573 29088 catalog_manager.cc:1347] Generated new cluster ID: 8d6085f257434ec4a0781a04feceebdb
I20260808 08:39:23.073694 29088 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:23.104457 29088 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:23.106381 29088 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:23.120918 29088 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7726a1f20d9046b3bff2bc06c1d0b636: Generated new TSK 0
I20260808 08:39:23.121904 29088 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:23.132946 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 28994
W20260808 08:39:23.134017 29058 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.110:60541
W20260808 08:39:23.134819 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 28994: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:39:23.134968 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 28994
W20260808 08:39:23.153219 28978 connection.cc:535] client connection to 127.0.0.1:34627 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34627): Connection reset by peer (error 104)
2026-08-08T08:39:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2085 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:23 dist-test-slave-chsk krb5kdc[29094](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:23 dist-test-slave-chsk krb5kdc[29094](info): set up 2 sockets
Aug 08 08:39:23 dist-test-slave-chsk krb5kdc[29094](info): commencing operation
krb5kdc: starting...
W20260808 08:39:24.311822 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.004s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:24 dist-test-slave-chsk krb5kdc[29094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178364, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 08:39:24.658661 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37681
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37681
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:25.008457 29107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:25.008734 29107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:25.008858 29107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:25.016021 29107 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:25.016141 29107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:25.016186 29107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:25.016248 29107 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:25.016292 29107 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:25.025873 29107 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37681
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:25.027077 29107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:25.028452 29107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:25.040284 29112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:25.040396 29113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:25.040781 29115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:25.041213 29107 server_base.cc:1034] running on GCE node
I20260808 08:39:25.041945 29107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:25.043412 29107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:25.044669 29107 hybrid_clock.cc:648] HybridClock initialized: now 1786178365044612 us; error 45 us; skew 500 ppm
I20260808 08:39:25.045053 29107 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:25 dist-test-slave-chsk krb5kdc[29094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178365, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:25.048280 29107 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 08:39:25.049633 29107 webserver.cc:460] Webserver started at http://127.0.0.1:43239/ using document root <none> and password file <none>
I20260808 08:39:25.050268 29107 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:25.050371 29107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:25.050625 29107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:25.054242 29107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "6257cd1e778f4722941e5c73f49e5546"
format_stamp: "Formatted at 2026-08-08 08:39:25 on dist-test-slave-chsk"
server_key: "6c0f4a1b0b82ee51f040d97b9ea60604"
server_key_iv: "f75e9602bf79b0330beed215c9409699"
server_key_version: "encryptionkey@0"
I20260808 08:39:25.055316 29107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "6257cd1e778f4722941e5c73f49e5546"
format_stamp: "Formatted at 2026-08-08 08:39:25 on dist-test-slave-chsk"
server_key: "6c0f4a1b0b82ee51f040d97b9ea60604"
server_key_iv: "f75e9602bf79b0330beed215c9409699"
server_key_version: "encryptionkey@0"
I20260808 08:39:25.060583 29107 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260808 08:39:25.063974 29123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:25.065207 29107 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:39:25.065336 29107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "6257cd1e778f4722941e5c73f49e5546"
format_stamp: "Formatted at 2026-08-08 08:39:25 on dist-test-slave-chsk"
server_key: "6c0f4a1b0b82ee51f040d97b9ea60604"
server_key_iv: "f75e9602bf79b0330beed215c9409699"
server_key_version: "encryptionkey@0"
I20260808 08:39:25.065495 29107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:25.071131 29107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:25.075560 29107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:25.075814 29107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:25.094491 29107 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37681
I20260808 08:39:25.094576 29178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37681 every 8 connection(s)
I20260808 08:39:25.096007 29107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:25.099759 29179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:25.102766 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 29107
I20260808 08:39:25.102953 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:25.103561 5779 external_mini_cluster.cc:1428] Setting key 4625603121a8c47bda6af351b48c2c2e
I20260808 08:39:25.111235 29182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:25.105377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:36637 (local address 127.0.0.1:37681)
0808 08:39:25.106141 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:25.106152 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:25.106198 (+ 46us) server_negotiation.cc:407] Connection header received
0808 08:39:25.107954 (+ 1756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:25.107976 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:25.108304 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:25.108611 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:25.109671 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:25.109681 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:25.109693 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:25.109714 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:25.109774 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:25.109796 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:25.109965 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:25.110109 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 08:39:25.110304 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":350,"threads_started":1}
I20260808 08:39:25.111941 29179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546: Bootstrap starting.
I20260808 08:39:25.114679 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:25.115204 29179 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:25.116580 29179 log.cc:824] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:25.119971 29179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546: No bootstrap required, opened a new log
I20260808 08:39:25.122560 29182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:25.120024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.110:39493 (local address 127.0.0.1:37681)
0808 08:39:25.120210 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:25.120216 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:25.120596 (+ 380us) server_negotiation.cc:407] Connection header received
0808 08:39:25.120765 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:25.120769 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:25.120811 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:25.120889 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:25.121883 (+ 994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:25.121887 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:25.121893 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:25.121908 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:25.121947 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:25.121964 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:25.122063 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:25.122203 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 08:39:25.122254 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:39:25.128176 29179 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6257cd1e778f4722941e5c73f49e5546" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37681 } }
I20260808 08:39:25.128530 29179 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:25.128628 29179 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6257cd1e778f4722941e5c73f49e5546, State: Initialized, Role: FOLLOWER
I20260808 08:39:25.129187 29179 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6257cd1e778f4722941e5c73f49e5546" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37681 } }
I20260808 08:39:25.129419 29179 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:25.129575 29179 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:25.129727 29179 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:25.131999 29179 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6257cd1e778f4722941e5c73f49e5546" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37681 } }
I20260808 08:39:25.132485 29179 leader_election.cc:302] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6257cd1e778f4722941e5c73f49e5546; no voters:
I20260808 08:39:25.133044 29179 leader_election.cc:288] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:25.133188 29190 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:25.133908 29190 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [term 1 LEADER]: Becoming Leader. State: Replica: 6257cd1e778f4722941e5c73f49e5546, State: Running, Role: LEADER
I20260808 08:39:25.134420 29190 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6257cd1e778f4722941e5c73f49e5546" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37681 } }
I20260808 08:39:25.135115 29179 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:25.137327 29191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6257cd1e778f4722941e5c73f49e5546" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6257cd1e778f4722941e5c73f49e5546" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37681 } } }
I20260808 08:39:25.137809 29191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:25.138664 29192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6257cd1e778f4722941e5c73f49e5546. Latest consensus state: current_term: 1 leader_uuid: "6257cd1e778f4722941e5c73f49e5546" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6257cd1e778f4722941e5c73f49e5546" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37681 } } }
I20260808 08:39:25.139016 29192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:25.140220 29195 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:25.145275 29195 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:25.154351 29195 catalog_manager.cc:1347] Generated new cluster ID: cf955a7c9c994b8d9966458509ecbc2a
I20260808 08:39:25.154488 29195 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:25.176764 29195 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:25.177280 29195 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:25.182715 29195 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6257cd1e778f4722941e5c73f49e5546: Generated new TSK 0
I20260808 08:39:25.183495 29195 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:25.191732 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 29107
W20260808 08:39:25.192876 29173 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.110:36637
W20260808 08:39:25.193529 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 29107: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:39:25.193684 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 29107
2026-08-08T08:39:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2059 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:25 dist-test-slave-chsk krb5kdc[29211](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:25 dist-test-slave-chsk krb5kdc[29211](info): set up 2 sockets
Aug 08 08:39:25 dist-test-slave-chsk krb5kdc[29211](info): commencing operation
krb5kdc: starting...
W20260808 08:39:26.367069 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:26 dist-test-slave-chsk krb5kdc[29211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:39:26.708393 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:35507
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:44891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:35507
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:27.066319 29224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:27.066614 29224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:27.066787 29224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:27.074287 29224 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:27.074414 29224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:27.074514 29224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:27.074633 29224 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:27.074707 29224 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:27.085070 29224 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:44891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:35507
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:35507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:27.086474 29224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:27.087910 29224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:27.099879 29232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:27.099934 29229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:27.099961 29230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:27.100826 29224 server_base.cc:1034] running on GCE node
I20260808 08:39:27.101637 29224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:27.103091 29224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:27.104365 29224 hybrid_clock.cc:648] HybridClock initialized: now 1786178367104322 us; error 36 us; skew 500 ppm
I20260808 08:39:27.104743 29224 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:27 dist-test-slave-chsk krb5kdc[29211](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178367, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:27.107875 29224 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:39:27.109411 29224 webserver.cc:460] Webserver started at http://127.5.164.254:39515/ using document root <none> and password file <none>
I20260808 08:39:27.110085 29224 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:27.110241 29224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:27.110554 29224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:27.113648 29224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "61ac6ba14fe843e28de344d40be86d64"
format_stamp: "Formatted at 2026-08-08 08:39:27 on dist-test-slave-chsk"
server_key: "b85dd46b5034535e48d4037354c0a485"
server_key_iv: "bfa0c1291fb7f0cb6703df7405570d68"
server_key_version: "encryptionkey@0"
I20260808 08:39:27.114447 29224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "61ac6ba14fe843e28de344d40be86d64"
format_stamp: "Formatted at 2026-08-08 08:39:27 on dist-test-slave-chsk"
server_key: "b85dd46b5034535e48d4037354c0a485"
server_key_iv: "bfa0c1291fb7f0cb6703df7405570d68"
server_key_version: "encryptionkey@0"
I20260808 08:39:27.119758 29224 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260808 08:39:27.123260 29239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:27.124619 29224 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:39:27.124817 29224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "61ac6ba14fe843e28de344d40be86d64"
format_stamp: "Formatted at 2026-08-08 08:39:27 on dist-test-slave-chsk"
server_key: "b85dd46b5034535e48d4037354c0a485"
server_key_iv: "bfa0c1291fb7f0cb6703df7405570d68"
server_key_version: "encryptionkey@0"
I20260808 08:39:27.125032 29224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:27.146021 29224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:27.150434 29224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:27.150743 29224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:27.170446 29224 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:35507
I20260808 08:39:27.170465 29292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:35507 every 8 connection(s)
I20260808 08:39:27.171896 29224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:27.172649 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 29224
I20260808 08:39:27.172852 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:27.173460 5779 external_mini_cluster.cc:1428] Setting key 9277fe417a1e797462fe29597eea8eaf
I20260808 08:39:27.176504 29293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 08:39:27 dist-test-slave-chsk krb5kdc[29211](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178366, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:39:27.189807 29293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64: Bootstrap starting.
I20260808 08:39:27.194047 29293 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:27.195426 29293 log.cc:824] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:27.198439 29293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64: No bootstrap required, opened a new log
I20260808 08:39:27.199425 29296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:27.175323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46727 (local address 127.5.164.254:35507)
0808 08:39:27.176118 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:27.176134 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:27.176183 (+ 49us) server_negotiation.cc:407] Connection header received
0808 08:39:27.178534 (+ 2351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:27.178561 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:27.179034 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:27.179510 (+ 476us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:27.180940 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:27.183107 (+ 2167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:27.184483 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:27.185527 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:27.185716 (+ 189us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:27.190537 (+ 4821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:27.190548 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:27.190568 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:27.190622 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:27.194710 (+ 4088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:27.195738 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:27.195745 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:27.195751 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:27.195938 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:27.196452 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:27.196456 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:27.196458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:27.197011 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:27.197365 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:27.197914 (+ 549us) server_negotiation.cc:299] Negotiation successful
0808 08:39:27.198246 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":320,"threads_started":1}
I20260808 08:39:27.204340 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:27.207811 29293 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ac6ba14fe843e28de344d40be86d64" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35507 } }
I20260808 08:39:27.208276 29293 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:27.208397 29293 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61ac6ba14fe843e28de344d40be86d64, State: Initialized, Role: FOLLOWER
I20260808 08:39:27.209182 29293 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ac6ba14fe843e28de344d40be86d64" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35507 } }
I20260808 08:39:27.209502 29293 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:27.209669 29293 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:27.209870 29293 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:27.212337 29293 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ac6ba14fe843e28de344d40be86d64" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35507 } }
I20260808 08:39:27.212853 29293 leader_election.cc:302] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61ac6ba14fe843e28de344d40be86d64; no voters:
I20260808 08:39:27.213467 29293 leader_election.cc:288] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:27.213606 29303 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:27.215693 29293 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:27.216712 29303 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [term 1 LEADER]: Becoming Leader. State: Replica: 61ac6ba14fe843e28de344d40be86d64, State: Running, Role: LEADER
I20260808 08:39:27.217336 29303 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ac6ba14fe843e28de344d40be86d64" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35507 } }
I20260808 08:39:27.219930 29305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61ac6ba14fe843e28de344d40be86d64. Latest consensus state: current_term: 1 leader_uuid: "61ac6ba14fe843e28de344d40be86d64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ac6ba14fe843e28de344d40be86d64" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35507 } } }
I20260808 08:39:27.220341 29305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:27.220798 29304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61ac6ba14fe843e28de344d40be86d64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ac6ba14fe843e28de344d40be86d64" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 35507 } } }
I20260808 08:39:27.221186 29304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:27.228626 29308 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:27.230671 29296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:27.209041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36015 (local address 127.5.164.254:35507)
0808 08:39:27.209250 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:27.209258 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:27.209675 (+ 417us) server_negotiation.cc:407] Connection header received
0808 08:39:27.209871 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:27.209876 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:27.209983 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:27.210108 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:27.211704 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:27.212520 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:27.214152 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:27.215169 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:27.215300 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:27.219074 (+ 3774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:27.219084 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:27.219092 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:27.219175 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:27.224535 (+ 5360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:27.225965 (+ 1430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:27.225973 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:27.225979 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:27.226208 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:27.227026 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:27.227034 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:27.227040 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:27.227575 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:27.229471 (+ 1896us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:27.229737 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 08:39:27.230060 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:39:27.236066 29308 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:27.246721 29308 catalog_manager.cc:1347] Generated new cluster ID: 6efecfa7dd4948f892c1b229882d4b5b
I20260808 08:39:27.246871 29308 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:27.263850 29308 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:27.265765 29308 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:27.275382 29308 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61ac6ba14fe843e28de344d40be86d64: Generated new TSK 0
I20260808 08:39:27.276495 29308 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:27.289219 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 29224
I20260808 08:39:27.290580 29288 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:39:27.384204 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 29224
W20260808 08:39:27.406073 29209 connection.cc:535] client connection to 127.5.164.254:35507 recv error: Network error: failed to read from TLS socket (remote: 127.5.164.254:35507): Connection reset by peer (error 104)
2026-08-08T08:39:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2193 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:27 dist-test-slave-chsk krb5kdc[29326](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:27 dist-test-slave-chsk krb5kdc[29326](info): set up 2 sockets
Aug 08 08:39:27 dist-test-slave-chsk krb5kdc[29326](info): commencing operation
krb5kdc: starting...
W20260808 08:39:28.560247 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:28 dist-test-slave-chsk krb5kdc[29326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178368, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:39:28.889957 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:45429
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:34089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:45429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:29.237794 29340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:29.238140 29340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:29.238309 29340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:29.246176 29340 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:29.246327 29340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:29.246416 29340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:29.246505 29340 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:29.246591 29340 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:29.256625 29340 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:34089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:45429
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:45429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:29.257920 29340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:29.259222 29340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:29.271014 29349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:29.271190 29346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:29.271124 29347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:29.276747 29340 server_base.cc:1034] running on GCE node
I20260808 08:39:29.277541 29340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:29.278962 29340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:29.280207 29340 hybrid_clock.cc:648] HybridClock initialized: now 1786178369280161 us; error 50 us; skew 500 ppm
I20260808 08:39:29.280570 29340 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:29 dist-test-slave-chsk krb5kdc[29326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178369, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:29.289776 29340 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:39:29.291383 29340 webserver.cc:460] Webserver started at http://127.5.164.254:33175/ using document root <none> and password file <none>
I20260808 08:39:29.292076 29340 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:29.292222 29340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:29.292523 29340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:29.295583 29340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "cdfac22fa5da4eb7946c8b1a3d9869c9"
format_stamp: "Formatted at 2026-08-08 08:39:29 on dist-test-slave-chsk"
server_key: "8943ec2a4d232bf4e319cd6ed55cdaf5"
server_key_iv: "e17e86bc934c43c3b0c3b4ac2035dba0"
server_key_version: "encryptionkey@0"
I20260808 08:39:29.296366 29340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "cdfac22fa5da4eb7946c8b1a3d9869c9"
format_stamp: "Formatted at 2026-08-08 08:39:29 on dist-test-slave-chsk"
server_key: "8943ec2a4d232bf4e319cd6ed55cdaf5"
server_key_iv: "e17e86bc934c43c3b0c3b4ac2035dba0"
server_key_version: "encryptionkey@0"
I20260808 08:39:29.301434 29340 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:39:29.304986 29356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:29.306347 29340 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:39:29.306533 29340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "cdfac22fa5da4eb7946c8b1a3d9869c9"
format_stamp: "Formatted at 2026-08-08 08:39:29 on dist-test-slave-chsk"
server_key: "8943ec2a4d232bf4e319cd6ed55cdaf5"
server_key_iv: "e17e86bc934c43c3b0c3b4ac2035dba0"
server_key_version: "encryptionkey@0"
I20260808 08:39:29.306784 29340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:29.329826 29340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:29.333976 29340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:29.334308 29340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:29.353345 29340 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:45429
I20260808 08:39:29.353439 29409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:45429 every 8 connection(s)
I20260808 08:39:29.354727 29340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:29.355064 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 29340
I20260808 08:39:29.355295 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:29.355986 5779 external_mini_cluster.cc:1428] Setting key a369c600670901dec933e744ff76f0df
I20260808 08:39:29.359215 29410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:29.369424 29414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:29.357854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34193 (local address 127.5.164.254:45429)
0808 08:39:29.358618 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:29.358629 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:29.358669 (+ 40us) server_negotiation.cc:407] Connection header received
0808 08:39:29.360408 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:29.360428 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:29.360789 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:29.361087 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:29.361741 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:29.363047 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:29.365013 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:29.365658 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:29.365795 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:29.367096 (+ 1301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:29.367103 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:29.367115 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:29.367709 (+ 594us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:29.367801 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:29.367824 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:29.367944 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:29.368260 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 08:39:29.368449 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":343,"threads_started":1}
I20260808 08:39:29.371471 29410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9: Bootstrap starting.
I20260808 08:39:29.373092 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:29.375056 29410 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:29.376418 29410 log.cc:824] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:29.379783 29410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9: No bootstrap required, opened a new log
I20260808 08:39:29.386425 29414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:29.379444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52411 (local address 127.5.164.254:45429)
0808 08:39:29.379684 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:29.379691 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:29.380060 (+ 369us) server_negotiation.cc:407] Connection header received
0808 08:39:29.380263 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:29.380267 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:29.380331 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:29.380412 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:29.381026 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:29.381816 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:29.383779 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:29.384256 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:29.384354 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:29.385631 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:29.385636 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:29.385639 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:29.385659 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:29.385697 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:29.385712 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:29.385798 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:29.386005 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 08:39:29.386049 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 08:39:29.389343 29410 raft_consensus.cc:348] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdfac22fa5da4eb7946c8b1a3d9869c9" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45429 } }
I20260808 08:39:29.389729 29410 raft_consensus.cc:374] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:29.389848 29410 raft_consensus.cc:729] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdfac22fa5da4eb7946c8b1a3d9869c9, State: Initialized, Role: FOLLOWER
I20260808 08:39:29.390388 29410 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdfac22fa5da4eb7946c8b1a3d9869c9" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45429 } }
I20260808 08:39:29.390633 29410 raft_consensus.cc:388] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:29.390792 29410 raft_consensus.cc:482] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:29.390991 29410 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:29.393244 29410 raft_consensus.cc:504] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdfac22fa5da4eb7946c8b1a3d9869c9" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45429 } }
I20260808 08:39:29.393745 29410 leader_election.cc:302] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdfac22fa5da4eb7946c8b1a3d9869c9; no voters:
I20260808 08:39:29.394338 29410 leader_election.cc:288] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:29.394483 29422 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:29.395249 29422 raft_consensus.cc:686] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [term 1 LEADER]: Becoming Leader. State: Replica: cdfac22fa5da4eb7946c8b1a3d9869c9, State: Running, Role: LEADER
I20260808 08:39:29.395819 29422 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdfac22fa5da4eb7946c8b1a3d9869c9" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45429 } }
I20260808 08:39:29.396442 29410 sys_catalog.cc:564] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:29.399574 29424 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdfac22fa5da4eb7946c8b1a3d9869c9. Latest consensus state: current_term: 1 leader_uuid: "cdfac22fa5da4eb7946c8b1a3d9869c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdfac22fa5da4eb7946c8b1a3d9869c9" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45429 } } }
I20260808 08:39:29.399636 29423 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cdfac22fa5da4eb7946c8b1a3d9869c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdfac22fa5da4eb7946c8b1a3d9869c9" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 45429 } } }
I20260808 08:39:29.400100 29424 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:29.400235 29423 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:29.401655 29432 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:29.406980 29432 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:29.416623 29432 catalog_manager.cc:1347] Generated new cluster ID: 1dc497c011dd46d0b7ad9cb869d8a87c
I20260808 08:39:29.416759 29432 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:29.489656 29432 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:29.491582 29432 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:29.500072 29432 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cdfac22fa5da4eb7946c8b1a3d9869c9: Generated new TSK 0
I20260808 08:39:29.500901 29432 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:29.511503 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 29340
W20260808 08:39:29.512792 29404 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:34193
W20260808 08:39:29.513662 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 29340: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:39:29.513836 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 29340
W20260808 08:39:29.533332 29324 connection.cc:535] client connection to 127.5.164.254:45429 recv error: Network error: failed to read from TLS socket (remote: 127.5.164.254:45429): Connection reset by peer (error 104)
2026-08-08T08:39:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2127 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:29 dist-test-slave-chsk krb5kdc[29444](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:29 dist-test-slave-chsk krb5kdc[29444](info): set up 2 sockets
Aug 08 08:39:29 dist-test-slave-chsk krb5kdc[29444](info): commencing operation
krb5kdc: starting...
W20260808 08:39:30.696010 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.011s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:30 dist-test-slave-chsk krb5kdc[29444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178370, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:39:31.038378 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:34197
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:42391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:34197
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:31.376999 29457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:31.377295 29457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:31.377452 29457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:31.384792 29457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:31.384907 29457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:31.384987 29457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:31.385098 29457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:31.385169 29457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:31.395129 29457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:42391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:34197
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:34197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:31.396466 29457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:31.397794 29457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:31.409727 29463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:31.409773 29464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:31.409679 29466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:31.410868 29457 server_base.cc:1034] running on GCE node
I20260808 08:39:31.411767 29457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:31.413210 29457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:31.414417 29457 hybrid_clock.cc:648] HybridClock initialized: now 1786178371414376 us; error 46 us; skew 500 ppm
I20260808 08:39:31.414765 29457 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:31 dist-test-slave-chsk krb5kdc[29444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178371, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:31.418049 29457 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:39:31.420017 29457 webserver.cc:460] Webserver started at http://127.5.164.254:42181/ using document root <none> and password file <none>
I20260808 08:39:31.421044 29457 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:31.421226 29457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:31.421666 29457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:31.426335 29457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "52194a0c43254abdaa8f3423a65a65d5"
format_stamp: "Formatted at 2026-08-08 08:39:31 on dist-test-slave-chsk"
server_key: "38bcf5e83c20824336dce7bb8d4b8a92"
server_key_iv: "5bb153bd4e4dbe5a2722cc8d3c40e65a"
server_key_version: "encryptionkey@0"
I20260808 08:39:31.427472 29457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "52194a0c43254abdaa8f3423a65a65d5"
format_stamp: "Formatted at 2026-08-08 08:39:31 on dist-test-slave-chsk"
server_key: "38bcf5e83c20824336dce7bb8d4b8a92"
server_key_iv: "5bb153bd4e4dbe5a2722cc8d3c40e65a"
server_key_version: "encryptionkey@0"
I20260808 08:39:31.432778 29457 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 08:39:31.436421 29473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:31.437847 29457 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260808 08:39:31.438055 29457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "52194a0c43254abdaa8f3423a65a65d5"
format_stamp: "Formatted at 2026-08-08 08:39:31 on dist-test-slave-chsk"
server_key: "38bcf5e83c20824336dce7bb8d4b8a92"
server_key_iv: "5bb153bd4e4dbe5a2722cc8d3c40e65a"
server_key_version: "encryptionkey@0"
I20260808 08:39:31.438289 29457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:31.444073 29457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:31.448463 29457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:31.448788 29457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:31.468268 29457 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:34197
I20260808 08:39:31.468291 29528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:34197 every 8 connection(s)
I20260808 08:39:31.469798 29457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:31.471698 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 29457
I20260808 08:39:31.471910 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:31.472476 5779 external_mini_cluster.cc:1428] Setting key 1296dfc2160aa8691cf6cd91a761a0b8
I20260808 08:39:31.474380 29529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:31.481179 29532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:31.474628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42107 (local address 127.5.164.254:34197)
0808 08:39:31.475650 (+ 1022us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:31.475667 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:31.475734 (+ 67us) server_negotiation.cc:407] Connection header received
0808 08:39:31.477599 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:31.477619 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:31.477950 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:31.478286 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:31.479464 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:31.479478 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:31.479494 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:31.479517 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:31.479640 (+ 123us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:31.479665 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:31.479836 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:31.479973 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 08:39:31.480184 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":688,"thread_start_us":448,"threads_started":1}
I20260808 08:39:31.485220 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:31.489441 29529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5: Bootstrap starting.
I20260808 08:39:31.493440 29529 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:31.493677 29532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:31.490695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39081 (local address 127.5.164.254:34197)
0808 08:39:31.490901 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:31.490908 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:31.491494 (+ 586us) server_negotiation.cc:407] Connection header received
0808 08:39:31.491647 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:31.491652 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:31.491738 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:31.491850 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:31.492844 (+ 994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:31.492850 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:31.492857 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:31.492875 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:31.492922 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:31.492942 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:31.493071 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:31.493250 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 08:39:31.493323 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:39:31.494818 29529 log.cc:824] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:31.497747 29529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5: No bootstrap required, opened a new log
I20260808 08:39:31.505276 29529 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52194a0c43254abdaa8f3423a65a65d5" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34197 } }
I20260808 08:39:31.505802 29529 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:31.505934 29529 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52194a0c43254abdaa8f3423a65a65d5, State: Initialized, Role: FOLLOWER
I20260808 08:39:31.506583 29529 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52194a0c43254abdaa8f3423a65a65d5" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34197 } }
I20260808 08:39:31.506824 29529 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:31.506981 29529 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:31.507184 29529 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:31.509404 29529 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52194a0c43254abdaa8f3423a65a65d5" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34197 } }
I20260808 08:39:31.509909 29529 leader_election.cc:302] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52194a0c43254abdaa8f3423a65a65d5; no voters:
I20260808 08:39:31.510536 29529 leader_election.cc:288] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:31.510725 29540 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:31.511554 29540 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [term 1 LEADER]: Becoming Leader. State: Replica: 52194a0c43254abdaa8f3423a65a65d5, State: Running, Role: LEADER
I20260808 08:39:31.512192 29540 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52194a0c43254abdaa8f3423a65a65d5" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34197 } }
I20260808 08:39:31.512738 29529 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:31.515407 29541 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52194a0c43254abdaa8f3423a65a65d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52194a0c43254abdaa8f3423a65a65d5" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34197 } } }
I20260808 08:39:31.515899 29541 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:31.516355 29542 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52194a0c43254abdaa8f3423a65a65d5. Latest consensus state: current_term: 1 leader_uuid: "52194a0c43254abdaa8f3423a65a65d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52194a0c43254abdaa8f3423a65a65d5" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 34197 } } }
I20260808 08:39:31.516695 29542 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:31.517470 29549 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:31.522619 29549 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:31.531111 29549 catalog_manager.cc:1347] Generated new cluster ID: d3d2ae377e704373bd2072cc73eaba2d
I20260808 08:39:31.531262 29549 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:31.558712 29549 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:31.559299 29549 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:31.566825 29549 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52194a0c43254abdaa8f3423a65a65d5: Generated new TSK 0
I20260808 08:39:31.567884 29549 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:31.583638 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 29457
W20260808 08:39:31.584987 29524 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:42107
W20260808 08:39:31.585753 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 29457: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:39:31.585924 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 29457
2026-08-08T08:39:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2073 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:31 dist-test-slave-chsk krb5kdc[29561](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:31 dist-test-slave-chsk krb5kdc[29561](info): set up 2 sockets
Aug 08 08:39:31 dist-test-slave-chsk krb5kdc[29561](info): commencing operation
krb5kdc: starting...
W20260808 08:39:32.768270 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.012s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:32 dist-test-slave-chsk krb5kdc[29561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:39:33.104652 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:43867
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:41625
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:43867
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:33.449496 29574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:33.449803 29574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:33.449916 29574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:33.457216 29574 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:33.457329 29574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:33.457376 29574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:33.457432 29574 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:33.457476 29574 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:33.467332 29574 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:41625
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:43867
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:43867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:33.468564 29574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:33.469846 29574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:33.483736 29582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:33.483881 29579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:33.483781 29580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:33.485366 29574 server_base.cc:1034] running on GCE node
I20260808 08:39:33.486081 29574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:33.487509 29574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:33.488716 29574 hybrid_clock.cc:648] HybridClock initialized: now 1786178373488682 us; error 32 us; skew 500 ppm
I20260808 08:39:33.489022 29574 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:33 dist-test-slave-chsk krb5kdc[29561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178373, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:33.492226 29574 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:39:33.493682 29574 webserver.cc:460] Webserver started at http://127.5.164.254:37637/ using document root <none> and password file <none>
I20260808 08:39:33.494364 29574 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:33.494506 29574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:33.494827 29574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:33.497862 29574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "64608b0643334e399516e26567b031d2"
format_stamp: "Formatted at 2026-08-08 08:39:33 on dist-test-slave-chsk"
server_key: "1369eea51968184f6c73e97592b05b40"
server_key_iv: "f26e39b906a4ea72927207544882e024"
server_key_version: "encryptionkey@0"
I20260808 08:39:33.498656 29574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "64608b0643334e399516e26567b031d2"
format_stamp: "Formatted at 2026-08-08 08:39:33 on dist-test-slave-chsk"
server_key: "1369eea51968184f6c73e97592b05b40"
server_key_iv: "f26e39b906a4ea72927207544882e024"
server_key_version: "encryptionkey@0"
I20260808 08:39:33.503728 29574 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260808 08:39:33.507082 29589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:33.508386 29574 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 08:39:33.508576 29574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "64608b0643334e399516e26567b031d2"
format_stamp: "Formatted at 2026-08-08 08:39:33 on dist-test-slave-chsk"
server_key: "1369eea51968184f6c73e97592b05b40"
server_key_iv: "f26e39b906a4ea72927207544882e024"
server_key_version: "encryptionkey@0"
I20260808 08:39:33.508767 29574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:33.527506 29574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:33.531570 29574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:33.531883 29574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:33.551429 29574 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:43867
I20260808 08:39:33.551447 29643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:43867 every 8 connection(s)
I20260808 08:39:33.552943 29574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:33.556751 29644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:33.557700 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 29574
I20260808 08:39:33.557898 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:33.558374 5779 external_mini_cluster.cc:1428] Setting key 3943c48f334232654659c35fb89a716a
I20260808 08:39:33.571434 29644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2: Bootstrap starting.
Aug 08 08:39:33 dist-test-slave-chsk krb5kdc[29561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178372, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:39:33.574553 29644 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:33.575994 29644 log.cc:824] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:33.579659 29644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2: No bootstrap required, opened a new log
I20260808 08:39:33.583774 29647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:33.560276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51907 (local address 127.5.164.254:43867)
0808 08:39:33.561160 (+ 884us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:33.561179 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:33.561240 (+ 61us) server_negotiation.cc:407] Connection header received
0808 08:39:33.563776 (+ 2536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:33.563804 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:33.564322 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:33.564758 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:33.566076 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:33.568114 (+ 2038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:33.569400 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:33.570424 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:33.570615 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:33.574692 (+ 4077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:33.574704 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:33.574726 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:33.574786 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:33.578891 (+ 4105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:33.579711 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:33.579721 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:33.579728 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:33.579934 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:33.580371 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:33.580377 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:33.580383 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:33.581119 (+ 736us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:33.581418 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:33.581832 (+ 414us) server_negotiation.cc:299] Negotiation successful
0808 08:39:33.582307 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":386,"threads_started":1}
I20260808 08:39:33.587695 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:33.589612 29644 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64608b0643334e399516e26567b031d2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43867 } }
I20260808 08:39:33.590049 29644 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:33.590167 29644 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64608b0643334e399516e26567b031d2, State: Initialized, Role: FOLLOWER
I20260808 08:39:33.590854 29644 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64608b0643334e399516e26567b031d2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43867 } }
I20260808 08:39:33.591199 29644 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:33.591389 29644 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:33.591595 29644 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:33.595017 29644 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64608b0643334e399516e26567b031d2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43867 } }
I20260808 08:39:33.595666 29644 leader_election.cc:302] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64608b0643334e399516e26567b031d2; no voters:
I20260808 08:39:33.596341 29644 leader_election.cc:288] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:33.596503 29655 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:33.597223 29655 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [term 1 LEADER]: Becoming Leader. State: Replica: 64608b0643334e399516e26567b031d2, State: Running, Role: LEADER
I20260808 08:39:33.597882 29655 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64608b0643334e399516e26567b031d2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43867 } }
I20260808 08:39:33.599570 29655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64608b0643334e399516e26567b031d2. Latest consensus state: current_term: 1 leader_uuid: "64608b0643334e399516e26567b031d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64608b0643334e399516e26567b031d2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43867 } } }
I20260808 08:39:33.599936 29655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:33.606148 29657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64608b0643334e399516e26567b031d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64608b0643334e399516e26567b031d2" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 43867 } } }
I20260808 08:39:33.606550 29657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:33.608796 29644 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:33.614578 29647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:33.593177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58123 (local address 127.5.164.254:43867)
0808 08:39:33.593451 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:33.593458 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:33.593881 (+ 423us) server_negotiation.cc:407] Connection header received
0808 08:39:33.594077 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:33.594081 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:33.594152 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:33.594232 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:33.596312 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:33.597621 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:33.600004 (+ 2383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:33.601018 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:33.601183 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:33.605536 (+ 4353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:33.605545 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:33.605553 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:33.605597 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:33.609818 (+ 4221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:33.610960 (+ 1142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:33.610969 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:33.610976 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:33.611195 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:33.611759 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:33.611767 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:33.611772 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:33.612451 (+ 679us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:33.612741 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:33.613744 (+ 1003us) server_negotiation.cc:299] Negotiation successful
0808 08:39:33.614060 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:39:33.620340 29659 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:33.626336 29659 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:33.635449 29659 catalog_manager.cc:1347] Generated new cluster ID: 032ce08f00c04abd891dffe3a17c6362
I20260808 08:39:33.635573 29659 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:33.650189 29659 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:33.651564 29659 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:33.662026 29659 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64608b0643334e399516e26567b031d2: Generated new TSK 0
I20260808 08:39:33.662890 29659 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:33.675773 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 29574
I20260808 08:39:33.676834 29639 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:39:33.774115 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 29574
2026-08-08T08:39:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2187 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:33 dist-test-slave-chsk krb5kdc[29678](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:33 dist-test-slave-chsk krb5kdc[29678](info): set up 2 sockets
Aug 08 08:39:33 dist-test-slave-chsk krb5kdc[29678](info): commencing operation
krb5kdc: starting...
W20260808 08:39:34.947824 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.007s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:35 dist-test-slave-chsk krb5kdc[29678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178375, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:39:35.294269 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:46777
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:41829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:46777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:35.643641 29692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:35.643936 29692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:35.644028 29692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:35.651206 29692 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:35.651315 29692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:35.651367 29692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:35.651428 29692 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:35.651472 29692 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:35.661290 29692 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:41829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:46777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:46777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:35.662540 29692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:35.663872 29692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:35.675555 29700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:35.675644 29698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:35.675833 29697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:35.676570 29692 server_base.cc:1034] running on GCE node
I20260808 08:39:35.677306 29692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:35.678617 29692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:35.679813 29692 hybrid_clock.cc:648] HybridClock initialized: now 1786178375679769 us; error 40 us; skew 500 ppm
I20260808 08:39:35.680126 29692 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:35 dist-test-slave-chsk krb5kdc[29678](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178375, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:35.687512 29692 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:39:35.689183 29692 webserver.cc:460] Webserver started at http://127.5.164.254:34069/ using document root <none> and password file <none>
I20260808 08:39:35.689885 29692 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:35.690038 29692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:35.690352 29692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:35.693411 29692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "ab1205ddccd34f7bbd4eeb15130446f4"
format_stamp: "Formatted at 2026-08-08 08:39:35 on dist-test-slave-chsk"
server_key: "ee5b5ef890787685060c35eb54a3ca82"
server_key_iv: "55b4692c883c9612b238a7bd93ca4407"
server_key_version: "encryptionkey@0"
I20260808 08:39:35.694196 29692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "ab1205ddccd34f7bbd4eeb15130446f4"
format_stamp: "Formatted at 2026-08-08 08:39:35 on dist-test-slave-chsk"
server_key: "ee5b5ef890787685060c35eb54a3ca82"
server_key_iv: "55b4692c883c9612b238a7bd93ca4407"
server_key_version: "encryptionkey@0"
I20260808 08:39:35.699543 29692 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260808 08:39:35.702978 29707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:35.704346 29692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:39:35.704543 29692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "ab1205ddccd34f7bbd4eeb15130446f4"
format_stamp: "Formatted at 2026-08-08 08:39:35 on dist-test-slave-chsk"
server_key: "ee5b5ef890787685060c35eb54a3ca82"
server_key_iv: "55b4692c883c9612b238a7bd93ca4407"
server_key_version: "encryptionkey@0"
I20260808 08:39:35.704751 29692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:35.736837 29692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:35.741173 29692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:35.741487 29692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:35.760970 29692 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:46777
I20260808 08:39:35.760994 29760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:46777 every 8 connection(s)
I20260808 08:39:35.762393 29692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:35.765990 29762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:35.769704 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 29692
I20260808 08:39:35.769915 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:35.770354 5779 external_mini_cluster.cc:1428] Setting key c47174d2ba525caf2c261fc17e89e0a8
I20260808 08:39:35.779009 29762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4: Bootstrap starting.
I20260808 08:39:35.782653 29762 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:35.783885 29762 log.cc:824] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:35.784354 29765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:35.772175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53397 (local address 127.5.164.254:46777)
0808 08:39:35.772958 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:35.772969 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:35.773008 (+ 39us) server_negotiation.cc:407] Connection header received
0808 08:39:35.774658 (+ 1650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:35.774681 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:35.775077 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:35.775475 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:35.776121 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:35.777794 (+ 1673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:35.779693 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:35.780364 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:35.780519 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:35.781843 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:35.781851 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:35.781863 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:35.782409 (+ 546us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:35.782488 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:35.782515 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:35.782606 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:35.782942 (+ 336us) server_negotiation.cc:299] Negotiation successful
0808 08:39:35.783286 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":365,"threads_started":1}
I20260808 08:39:35.787055 29762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4: No bootstrap required, opened a new log
I20260808 08:39:35.788262 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:35.795912 29762 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1205ddccd34f7bbd4eeb15130446f4" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46777 } }
I20260808 08:39:35.796447 29762 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:35.796550 29762 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab1205ddccd34f7bbd4eeb15130446f4, State: Initialized, Role: FOLLOWER
I20260808 08:39:35.797207 29762 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1205ddccd34f7bbd4eeb15130446f4" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46777 } }
I20260808 08:39:35.797483 29762 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:35.797680 29762 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:35.797883 29762 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:35.799595 29765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:35.792717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55627 (local address 127.5.164.254:46777)
0808 08:39:35.792949 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:35.792957 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:35.793401 (+ 444us) server_negotiation.cc:407] Connection header received
0808 08:39:35.793594 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:35.793598 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:35.793665 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:35.793750 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:35.794401 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:35.795103 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:35.796985 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:35.797482 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:35.797611 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:35.798802 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:35.798806 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:35.798809 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:35.798827 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:35.798868 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:35.798883 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:35.798956 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:35.799111 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 08:39:35.799238 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 08:39:35.800963 29762 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1205ddccd34f7bbd4eeb15130446f4" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46777 } }
I20260808 08:39:35.801466 29762 leader_election.cc:302] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab1205ddccd34f7bbd4eeb15130446f4; no voters:
I20260808 08:39:35.802083 29762 leader_election.cc:288] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:35.802263 29772 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:35.802940 29772 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [term 1 LEADER]: Becoming Leader. State: Replica: ab1205ddccd34f7bbd4eeb15130446f4, State: Running, Role: LEADER
I20260808 08:39:35.803560 29772 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1205ddccd34f7bbd4eeb15130446f4" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46777 } }
I20260808 08:39:35.804512 29762 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:35.806471 29773 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab1205ddccd34f7bbd4eeb15130446f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1205ddccd34f7bbd4eeb15130446f4" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46777 } } }
I20260808 08:39:35.806962 29773 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:35.807482 29774 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab1205ddccd34f7bbd4eeb15130446f4. Latest consensus state: current_term: 1 leader_uuid: "ab1205ddccd34f7bbd4eeb15130446f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1205ddccd34f7bbd4eeb15130446f4" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 46777 } } }
I20260808 08:39:35.807791 29774 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4 [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:35.811358 29781 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:35.816790 29781 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:35.825984 29781 catalog_manager.cc:1347] Generated new cluster ID: 79b2c44ed0e248d9ae993784ac7473b7
I20260808 08:39:35.826105 29781 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:35.837750 29781 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:35.839048 29781 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:35.850157 29781 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab1205ddccd34f7bbd4eeb15130446f4: Generated new TSK 0
I20260808 08:39:35.850987 29781 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:35.858726 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 29692
W20260808 08:39:35.859808 29756 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:53397
W20260808 08:39:35.860558 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 29692: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:39:35.860728 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 29692
2026-08-08T08:39:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2086 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:35 dist-test-slave-chsk krb5kdc[29794](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:35 dist-test-slave-chsk krb5kdc[29794](info): set up 2 sockets
Aug 08 08:39:35 dist-test-slave-chsk krb5kdc[29794](info): commencing operation
krb5kdc: starting...
W20260808 08:39:37.041416 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.001s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:37 dist-test-slave-chsk krb5kdc[29794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178377, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:39:37.392172 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:41925
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:32997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:41925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:37.744237 29808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:37.744521 29808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:37.744700 29808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:37.751952 29808 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:37.752082 29808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:37.752183 29808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:37.752291 29808 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:37.752377 29808 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:37.762277 29808 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:32997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:41925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:41925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:37.763666 29808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:37.764971 29808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:37.776484 29813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:37.776542 29814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:37.776443 29816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:37.777637 29808 server_base.cc:1034] running on GCE node
I20260808 08:39:37.778401 29808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:37.779827 29808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:37.781059 29808 hybrid_clock.cc:648] HybridClock initialized: now 1786178377781026 us; error 47 us; skew 500 ppm
I20260808 08:39:37.781412 29808 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:37 dist-test-slave-chsk krb5kdc[29794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178377, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:37.784567 29808 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:39:37.786047 29808 webserver.cc:460] Webserver started at http://127.5.164.254:37789/ using document root <none> and password file <none>
I20260808 08:39:37.786675 29808 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:37.786778 29808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:37.787086 29808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:37.790041 29808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "eca262a49ffe49348cc7fe788a90d92f"
format_stamp: "Formatted at 2026-08-08 08:39:37 on dist-test-slave-chsk"
server_key: "9328d02ed679893072cff66dd5ba3fff"
server_key_iv: "a8d4da9bdb1ddcf6adfc02e2dd6415c1"
server_key_version: "encryptionkey@0"
I20260808 08:39:37.790925 29808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "eca262a49ffe49348cc7fe788a90d92f"
format_stamp: "Formatted at 2026-08-08 08:39:37 on dist-test-slave-chsk"
server_key: "9328d02ed679893072cff66dd5ba3fff"
server_key_iv: "a8d4da9bdb1ddcf6adfc02e2dd6415c1"
server_key_version: "encryptionkey@0"
I20260808 08:39:37.796272 29808 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 08:39:37.799592 29823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:37.800870 29808 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 08:39:37.801057 29808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "eca262a49ffe49348cc7fe788a90d92f"
format_stamp: "Formatted at 2026-08-08 08:39:37 on dist-test-slave-chsk"
server_key: "9328d02ed679893072cff66dd5ba3fff"
server_key_iv: "a8d4da9bdb1ddcf6adfc02e2dd6415c1"
server_key_version: "encryptionkey@0"
I20260808 08:39:37.801265 29808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:37.806945 29808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:37.810693 29808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:37.810988 29808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:37.829795 29808 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:41925
I20260808 08:39:37.829818 29876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:41925 every 8 connection(s)
I20260808 08:39:37.831246 29808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:37.834828 29877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:37.838006 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 29808
I20260808 08:39:37.838232 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:37.838660 5779 external_mini_cluster.cc:1428] Setting key b902fa04fc53a31a58e5dc47ff9015d5
I20260808 08:39:37.846354 29880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:37.840471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47447 (local address 127.5.164.254:41925)
0808 08:39:37.841229 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:37.841240 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:37.841282 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:39:37.842940 (+ 1658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:37.842961 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:37.843373 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:37.843705 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:37.844829 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:37.844835 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:37.844846 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:37.844871 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:37.844932 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:37.844951 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:37.845120 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:37.845247 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 08:39:37.845440 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":339,"threads_started":1}
I20260808 08:39:37.847196 29877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f: Bootstrap starting.
I20260808 08:39:37.850164 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:37.850654 29877 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:37.851722 29877 log.cc:824] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:37.854965 29877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f: No bootstrap required, opened a new log
I20260808 08:39:37.857568 29880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:37.854837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53135 (local address 127.5.164.254:41925)
0808 08:39:37.855034 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:37.855040 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:37.855611 (+ 571us) server_negotiation.cc:407] Connection header received
0808 08:39:37.855748 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:37.855753 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:37.855822 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:37.855935 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:37.856887 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:37.856893 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:37.856898 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 08:39:37.856918 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:37.856966 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 08:39:37.856985 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:37.857111 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:37.857185 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 08:39:37.857244 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 08:39:37.863528 29877 raft_consensus.cc:348] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca262a49ffe49348cc7fe788a90d92f" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 41925 } }
I20260808 08:39:37.863880 29877 raft_consensus.cc:374] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 08:39:37.863955 29877 raft_consensus.cc:729] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eca262a49ffe49348cc7fe788a90d92f, State: Initialized, Role: FOLLOWER
I20260808 08:39:37.864462 29877 consensus_queue.cc:260] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca262a49ffe49348cc7fe788a90d92f" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 41925 } }
I20260808 08:39:37.864799 29877 raft_consensus.cc:388] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 08:39:37.864971 29877 raft_consensus.cc:482] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 08:39:37.865175 29877 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:37.867447 29877 raft_consensus.cc:504] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca262a49ffe49348cc7fe788a90d92f" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 41925 } }
I20260808 08:39:37.867949 29877 leader_election.cc:302] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eca262a49ffe49348cc7fe788a90d92f; no voters:
I20260808 08:39:37.868533 29877 leader_election.cc:288] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 08:39:37.868674 29887 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:37.869462 29887 raft_consensus.cc:686] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [term 1 LEADER]: Becoming Leader. State: Replica: eca262a49ffe49348cc7fe788a90d92f, State: Running, Role: LEADER
I20260808 08:39:37.870025 29887 consensus_queue.cc:237] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca262a49ffe49348cc7fe788a90d92f" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 41925 } }
I20260808 08:39:37.870746 29877 sys_catalog.cc:564] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:37.873092 29889 sys_catalog.cc:455] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [sys.catalog]: SysCatalogTable state changed. Reason: New leader eca262a49ffe49348cc7fe788a90d92f. Latest consensus state: current_term: 1 leader_uuid: "eca262a49ffe49348cc7fe788a90d92f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca262a49ffe49348cc7fe788a90d92f" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 41925 } } }
I20260808 08:39:37.873651 29889 sys_catalog.cc:458] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:37.873238 29888 sys_catalog.cc:455] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eca262a49ffe49348cc7fe788a90d92f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eca262a49ffe49348cc7fe788a90d92f" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 41925 } } }
I20260808 08:39:37.875898 29888 sys_catalog.cc:458] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:37.877761 29896 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:37.882910 29896 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:37.892518 29896 catalog_manager.cc:1347] Generated new cluster ID: 783919b03d684af2935c1f85d2a78a04
I20260808 08:39:37.892663 29896 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:37.919615 29896 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:37.920094 29896 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:37.929015 29896 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eca262a49ffe49348cc7fe788a90d92f: Generated new TSK 0
I20260808 08:39:37.929822 29896 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:37.943504 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 29808
W20260808 08:39:37.944648 29872 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:47447
W20260808 08:39:37.945305 5779 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 29808: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260808 08:39:37.945465 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 29808
2026-08-08T08:39:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2084 ms)
[----------] 18 tests from AuthTokenIssuingTest (38254 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:38 dist-test-slave-chsk krb5kdc[29909](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:38 dist-test-slave-chsk krb5kdc[29909](info): set up 2 sockets
Aug 08 08:39:38 dist-test-slave-chsk krb5kdc[29909](info): commencing operation
krb5kdc: starting...
W20260808 08:39:39.133208 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.003s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:39 dist-test-slave-chsk krb5kdc[29909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:39:39.470433 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:38535
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:45491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:38535,127.5.164.253:34059,127.5.164.252:40763
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:39.821966 29922 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:39:39.822393 29922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:39.822521 29922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:39.822661 29922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:39.829978 29922 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:39.830132 29922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:39.830266 29922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:39.830353 29922 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:39.830459 29922 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:39.840576 29922 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:38535,127.5.164.253:34059,127.5.164.252:40763
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:38535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:39.841951 29922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:39.843384 29922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:39.855288 29927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:39.855316 29928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:39.855218 29930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:39.856293 29922 server_base.cc:1034] running on GCE node
I20260808 08:39:39.857000 29922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:39.858393 29922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:39.859614 29922 hybrid_clock.cc:648] HybridClock initialized: now 1786178379859560 us; error 31 us; skew 500 ppm
I20260808 08:39:39.859910 29922 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:39 dist-test-slave-chsk krb5kdc[29909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178379, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:39.863229 29922 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:39:39.864733 29922 webserver.cc:460] Webserver started at http://127.5.164.254:44945/ using document root <none> and password file <none>
I20260808 08:39:39.865428 29922 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:39.865545 29922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:39.865895 29922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:39.869009 29922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "3d1dc9be2a464d06879897ffe72350bf"
format_stamp: "Formatted at 2026-08-08 08:39:39 on dist-test-slave-chsk"
server_key: "97b2c79b136753f3b5f1e7f9b70f15c3"
server_key_iv: "5d1fe04154eeeae0716bc516cfcc701e"
server_key_version: "encryptionkey@0"
I20260808 08:39:39.869879 29922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "3d1dc9be2a464d06879897ffe72350bf"
format_stamp: "Formatted at 2026-08-08 08:39:39 on dist-test-slave-chsk"
server_key: "97b2c79b136753f3b5f1e7f9b70f15c3"
server_key_iv: "5d1fe04154eeeae0716bc516cfcc701e"
server_key_version: "encryptionkey@0"
I20260808 08:39:39.875439 29922 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260808 08:39:39.878917 29938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:39.880321 29922 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:39:39.880519 29922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "3d1dc9be2a464d06879897ffe72350bf"
format_stamp: "Formatted at 2026-08-08 08:39:39 on dist-test-slave-chsk"
server_key: "97b2c79b136753f3b5f1e7f9b70f15c3"
server_key_iv: "5d1fe04154eeeae0716bc516cfcc701e"
server_key_version: "encryptionkey@0"
I20260808 08:39:39.880746 29922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:39.902599 29922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:39.906896 29922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:39.907226 29922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:39.927081 29922 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:38535
I20260808 08:39:39.927114 29992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:38535 every 8 connection(s)
I20260808 08:39:39.928580 29922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:39.932374 29993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:39.933347 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 29922
I20260808 08:39:39.933585 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:39.934463 5779 external_mini_cluster.cc:1428] Setting key bd98edb1394d79d99fdbcdd39d253fe9
I20260808 08:39:39.942867 29993 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:39:39 dist-test-slave-chsk krb5kdc[29909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178379, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:39:39.969991 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:39.947211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38535 (local address 127.0.0.1:51100)
0808 08:39:39.948237 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:39.948290 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:39.951035 (+ 2745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:39.952080 (+ 1045us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:39.952085 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:39.952676 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:39.953023 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:39.953040 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:39.955491 (+ 2451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:39.955496 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:39.956574 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:39.956587 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:39.957979 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:39.957984 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:39.958110 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:39.958842 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:39.958870 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:39.961425 (+ 2555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:39.965893 (+ 4468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:39.965904 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:39.965912 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:39.966311 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:39.966816 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:39.966820 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:39.966822 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:39.966969 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:39.967990 (+ 1021us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:39.967996 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:39.968236 (+ 240us) client_negotiation.cc:769] Sending connection context
0808 08:39:39.968503 (+ 267us) client_negotiation.cc:240] Negotiation successful
0808 08:39:39.968933 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"thread_start_us":416,"threads_started":1}
I20260808 08:39:39.970034 29996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:39.947211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51100 (local address 127.5.164.254:38535)
0808 08:39:39.949202 (+ 1991us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:39.949208 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:39.949250 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:39:39.951493 (+ 2243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:39.951500 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:39.951828 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:39.952068 (+ 240us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:39.953239 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:39.955341 (+ 2102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:39.956728 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:39.957762 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:39.957965 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:39.961677 (+ 3712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:39.961689 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:39.961708 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:39.961757 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:39.965760 (+ 4003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:39.966446 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:39.966457 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:39.966464 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:39.966700 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:39.967081 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:39.967096 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:39.967102 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:39.967846 (+ 744us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:39.968059 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:39.968684 (+ 625us) server_negotiation.cc:299] Negotiation successful
0808 08:39:39.969169 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":124,"server-negotiator.queue_time_us":1782,"spinlock_wait_cycles":23936,"thread_start_us":1532,"threads_started":1}
WARNING: no policy specified for kudu/127.5.164.253@KRBTEST.COM; defaulting to no policy
I20260808 08:39:39.972990 29993 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:39:39.973979 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:39.973612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:34059 (local address 127.0.0.1:37682)
0808 08:39:39.973778 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:39.973882 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 08:39:39.974237 29940 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.164.253:34059: connect: Connection refused (error 111)
I20260808 08:39:39.975701 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:39.975375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:34059 (local address 127.0.0.1:37688)
0808 08:39:39.975510 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:39.975587 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.253@KRBTEST.COM" created.
W20260808 08:39:39.975951 29993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.253:34059: Network error: Client connection negotiation failed: client connection to 127.5.164.253:34059: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.253.keytab.
Entry for principal kudu/127.5.164.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.253.keytab.
I20260808 08:39:40.014684 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.253:34059
--webserver_interface=127.5.164.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.253.keytab
--principal=kudu/127.5.164.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:45491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:38535,127.5.164.253:34059,127.5.164.252:40763
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:39:40.025338 29993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } attempt: 1
I20260808 08:39:40.026618 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.026143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:34059 (local address 127.0.0.1:37696)
0808 08:39:40.026350 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.026460 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 08:39:40.027725 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.027363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:34059 (local address 127.0.0.1:37710)
0808 08:39:40.027522 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.027595 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 08:39:40.027915 29993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.253:34059: Network error: Client connection negotiation failed: client connection to 127.5.164.253:34059: connect: Connection refused (error 111)
I20260808 08:39:40.096191 29993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } attempt: 2
I20260808 08:39:40.097625 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.096942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:34059 (local address 127.0.0.1:37712)
0808 08:39:40.097316 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.097433 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 08:39:40.098802 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.098327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:34059 (local address 127.0.0.1:37716)
0808 08:39:40.098510 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.098636 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 08:39:40.099016 29993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.253:34059: Network error: Client connection negotiation failed: client connection to 127.5.164.253:34059: connect: Connection refused (error 111)
I20260808 08:39:40.190294 29993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } attempt: 3
I20260808 08:39:40.191583 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.191033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:34059 (local address 127.0.0.1:37726)
0808 08:39:40.191296 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.191414 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 08:39:40.192684 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.192273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:34059 (local address 127.0.0.1:37730)
0808 08:39:40.192429 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.192513 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 08:39:40.192880 29993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.253:34059: Network error: Client connection negotiation failed: client connection to 127.5.164.253:34059: connect: Connection refused (error 111)
I20260808 08:39:40.336140 29993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } attempt: 4
I20260808 08:39:40.337525 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.336846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:34059 (local address 127.0.0.1:37732)
0808 08:39:40.337198 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.337341 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188}
I20260808 08:39:40.338757 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.338224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:34059 (local address 127.0.0.1:37736)
0808 08:39:40.338481 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.338601 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:34059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 08:39:40.338968 29993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.253:34059: Network error: Client connection negotiation failed: client connection to 127.5.164.253:34059: connect: Connection refused (error 111)
W20260808 08:39:40.357676 30001 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:39:40.358021 30001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:40.358141 30001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:40.358274 30001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:40.365500 30001 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:40.365587 30001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:40.365690 30001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:40.365777 30001 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:40.365883 30001 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:40.375739 30001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:38535,127.5.164.253:34059,127.5.164.252:40763
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.253.keytab
--principal=kudu/127.5.164.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.253:34059
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.5.164.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:40.377067 30001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:40.378468 30001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:40.390619 30007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:40.390666 30006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:40.390635 30010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:40.391508 30001 server_base.cc:1034] running on GCE node
I20260808 08:39:40.392266 30001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:40.393605 30001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:40.394845 30001 hybrid_clock.cc:648] HybridClock initialized: now 1786178380394771 us; error 51 us; skew 500 ppm
I20260808 08:39:40.395221 30001 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:40 dist-test-slave-chsk krb5kdc[29909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178380, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:40.398506 30001 init.cc:377] Logged in from keytab as kudu/127.5.164.253@KRBTEST.COM (short username kudu)
I20260808 08:39:40.399911 30001 webserver.cc:460] Webserver started at http://127.5.164.253:38193/ using document root <none> and password file <none>
I20260808 08:39:40.400605 30001 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:40.400720 30001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:40.401050 30001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:40.404042 30001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/data/instance:
uuid: "d7284c4d73f24a2dacd882bf0ba6b618"
format_stamp: "Formatted at 2026-08-08 08:39:40 on dist-test-slave-chsk"
server_key: "fd78299dbe2585e8aa27237230e6ec71"
server_key_iv: "3a46525adabffedaa29b7d5af963a480"
server_key_version: "encryptionkey@0"
I20260808 08:39:40.404819 30001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/wal/instance:
uuid: "d7284c4d73f24a2dacd882bf0ba6b618"
format_stamp: "Formatted at 2026-08-08 08:39:40 on dist-test-slave-chsk"
server_key: "fd78299dbe2585e8aa27237230e6ec71"
server_key_iv: "3a46525adabffedaa29b7d5af963a480"
server_key_version: "encryptionkey@0"
I20260808 08:39:40.409915 30001 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260808 08:39:40.413285 30017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:40.414556 30001 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260808 08:39:40.414733 30001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/wal
uuid: "d7284c4d73f24a2dacd882bf0ba6b618"
format_stamp: "Formatted at 2026-08-08 08:39:40 on dist-test-slave-chsk"
server_key: "fd78299dbe2585e8aa27237230e6ec71"
server_key_iv: "3a46525adabffedaa29b7d5af963a480"
server_key_version: "encryptionkey@0"
I20260808 08:39:40.414944 30001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:40.435909 30001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:40.440083 30001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:40.440320 30001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:40.459370 30001 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.253:34059
I20260808 08:39:40.459378 30069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.253:34059 every 8 connection(s)
I20260808 08:39:40.460721 30001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/data/info.pb
I20260808 08:39:40.464315 30070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:40.469652 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 30001
I20260808 08:39:40.469838 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-1/wal/instance
I20260808 08:39:40.470386 5779 external_mini_cluster.cc:1428] Setting key d75203b7940fafc2800d09581accc65b
I20260808 08:39:40.471578 30070 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:39:40 dist-test-slave-chsk krb5kdc[29909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178380, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.253@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:39:40.498171 30072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.475122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51102 (local address 127.5.164.254:38535)
0808 08:39:40.475742 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:40.475750 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:40.476788 (+ 1038us) server_negotiation.cc:407] Connection header received
0808 08:39:40.479598 (+ 2810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:40.479603 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:40.479684 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:40.479818 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:40.481958 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:40.482814 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:40.485285 (+ 2471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:40.486036 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:40.486176 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:40.490049 (+ 3873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:40.490060 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:40.490069 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:40.490126 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:40.494457 (+ 4331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:40.495245 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:40.495254 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:40.495261 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:40.495424 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:40.495923 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:40.495933 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:40.495940 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:40.496418 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:40.496594 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:40.497282 (+ 688us) server_negotiation.cc:299] Negotiation successful
0808 08:39:40.497605 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":283,"threads_started":1}
I20260808 08:39:40.498715 30073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.475765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38535 (local address 127.0.0.1:51102)
0808 08:39:40.476570 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.476627 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:40.479297 (+ 2670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:40.480074 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:40.480087 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:40.480889 (+ 802us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:40.481705 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:40.481734 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:40.482993 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:40.483001 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:40.485099 (+ 2098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:40.485117 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:40.486281 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:40.486289 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:40.486565 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:40.487334 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:40.487356 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:40.489803 (+ 2447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:40.494619 (+ 4816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:40.494625 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:40.494647 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:40.495066 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:40.495546 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:40.495550 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:40.495552 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:40.495756 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:40.496552 (+ 796us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:40.496558 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:40.496900 (+ 342us) client_negotiation.cc:769] Sending connection context
0808 08:39:40.497117 (+ 217us) client_negotiation.cc:240] Negotiation successful
0808 08:39:40.497467 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":308,"threads_started":1}
I20260808 08:39:40.500589 30070 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.5.164.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.252@KRBTEST.COM" created.
Aug 08 08:39:40 dist-test-slave-chsk krb5kdc[29909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178380, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.253@KRBTEST.COM for kudu/127.5.164.253@KRBTEST.COM
I20260808 08:39:40.520792 30075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.501809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37740 (local address 127.5.164.253:34059)
0808 08:39:40.502482 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:40.502487 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:40.502512 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:39:40.502551 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:40.502556 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:40.502724 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:40.502832 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:40.504063 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:40.505273 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:40.507464 (+ 2191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:40.507980 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:40.508080 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:40.514766 (+ 6686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:40.514778 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:40.514792 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:40.514826 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:40.517680 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:40.518516 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:40.518528 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:40.518535 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:40.518681 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:40.519113 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:40.519116 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:40.519118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:40.519503 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:40.519771 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:40.520202 (+ 431us) server_negotiation.cc:299] Negotiation successful
0808 08:39:40.520493 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":93,"server-negotiator.queue_time_us":539,"thread_start_us":422,"threads_started":1}
I20260808 08:39:40.520869 30073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.501467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:34059 (local address 127.0.0.1:37740)
0808 08:39:40.501656 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.501671 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:40.501750 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:40.502912 (+ 1162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:40.502924 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:40.503529 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:40.503818 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:40.503836 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:40.505449 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:40.505457 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:40.507302 (+ 1845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:40.507324 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:40.508158 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:40.508171 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:40.508399 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:40.509034 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:40.509059 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:40.514554 (+ 5495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:40.517812 (+ 3258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:40.517820 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:40.517826 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:40.518355 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:40.518795 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:40.518803 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:40.518808 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:40.518982 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:40.519731 (+ 749us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:40.519738 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:40.519900 (+ 162us) client_negotiation.cc:769] Sending connection context
0808 08:39:40.520051 (+ 151us) client_negotiation.cc:240] Negotiation successful
0808 08:39:40.520376 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 08:39:40.523464 30070 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:39:40.524516 30073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.524121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:43942)
0808 08:39:40.524271 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.524378 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 08:39:40.524753 30020 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
I20260808 08:39:40.526276 30073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.525932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:43954)
0808 08:39:40.526111 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.526183 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 08:39:40.526464 30070 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:40763: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.252.keytab.
Entry for principal kudu/127.5.164.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.252.keytab.
I20260808 08:39:40.554194 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.252:40763
--webserver_interface=127.5.164.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.252.keytab
--principal=kudu/127.5.164.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:45491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:38535,127.5.164.253:34059,127.5.164.252:40763
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:39:40.575766 30070 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } attempt: 1
I20260808 08:39:40.577095 30073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.576482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:43970)
0808 08:39:40.576741 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.576881 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 08:39:40.578352 30073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.577859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:43982)
0808 08:39:40.578039 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.578170 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 08:39:40.578644 30070 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:40763: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
I20260808 08:39:40.638242 29993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } attempt: 5
Aug 08 08:39:40 dist-test-slave-chsk krb5kdc[29909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178379, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for kudu/127.5.164.253@KRBTEST.COM
I20260808 08:39:40.646878 30070 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } attempt: 2
I20260808 08:39:40.647984 30073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.647485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:43996)
0808 08:39:40.647693 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.647792 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 08:39:40.649662 30073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.649219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:44006)
0808 08:39:40.649388 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.649481 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 08:39:40.650002 30070 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:40763: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
I20260808 08:39:40.653697 30075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.639222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37754 (local address 127.5.164.253:34059)
0808 08:39:40.639412 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:40.639417 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:40.639464 (+ 47us) server_negotiation.cc:407] Connection header received
0808 08:39:40.639685 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:40.639688 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:40.639751 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:40.639837 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:40.640842 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:40.641533 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:40.643523 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:40.643954 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:40.644049 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:40.647972 (+ 3923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:40.647976 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:40.647980 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:40.648018 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:40.651048 (+ 3030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:40.651725 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:40.651731 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:40.651734 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:40.651863 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:40.652262 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:40.652267 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:40.652270 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:40.652605 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:40.652762 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:40.653161 (+ 399us) server_negotiation.cc:299] Negotiation successful
0808 08:39:40.653378 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 08:39:40.653720 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.639053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:34059 (local address 127.0.0.1:37754)
0808 08:39:40.639364 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.639391 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:40.639554 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:40.639906 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:40.639911 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:40.640461 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:40.640692 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:40.640705 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:40.641679 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:40.641688 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:40.643368 (+ 1680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:40.643383 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:40.644113 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:40.644120 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:40.644362 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:40.645023 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:40.645046 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:40.647772 (+ 2726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:40.651212 (+ 3440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:40.651219 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:40.651228 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:40.651592 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:40.651987 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:40.652002 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:40.652004 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:40.652138 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:40.652728 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:40.652733 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:40.652888 (+ 155us) client_negotiation.cc:769] Sending connection context
0808 08:39:40.653040 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 08:39:40.653374 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260808 08:39:40.654647 29993 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:39:40.655720 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.655281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:44012)
0808 08:39:40.655458 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.655552 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 08:39:40.656693 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.656315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:44022)
0808 08:39:40.656471 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.656553 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 08:39:40.656940 29993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:40763: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
I20260808 08:39:40.708199 29993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } attempt: 1
I20260808 08:39:40.709628 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.708959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:44028)
0808 08:39:40.709240 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.709378 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 08:39:40.710772 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.710304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:44036)
0808 08:39:40.710507 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.710613 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 08:39:40.711009 29993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:40763: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
I20260808 08:39:40.741252 30070 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } attempt: 3
I20260808 08:39:40.742583 30073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.741984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:44044)
0808 08:39:40.742249 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.742365 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 08:39:40.743719 30073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.743257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:44050)
0808 08:39:40.743484 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.743579 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260808 08:39:40.743947 30070 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:40763: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
I20260808 08:39:40.779253 29993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } attempt: 2
I20260808 08:39:40.780570 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.779982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:44062)
0808 08:39:40.780240 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.780366 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 08:39:40.781702 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.781294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:44070)
0808 08:39:40.781482 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.781569 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 08:39:40.781935 29993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:40763: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
I20260808 08:39:40.887219 30070 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } attempt: 4
I20260808 08:39:40.888166 29993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } attempt: 3
I20260808 08:39:40.888530 30073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.887936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:44076)
0808 08:39:40.888235 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.888343 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 08:39:40.889200 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.888733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:44080)
0808 08:39:40.888910 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.888996 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 08:39:40.889704 30073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.889304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:44092)
0808 08:39:40.889481 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.889569 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 08:39:40.889943 30070 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:40763: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
I20260808 08:39:40.890280 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:40.889814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:44104)
0808 08:39:40.890089 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:40.890187 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160}
W20260808 08:39:40.890476 29993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:40763: Network error: Client connection negotiation failed: client connection to 127.5.164.252:40763: connect: Connection refused (error 111)
W20260808 08:39:40.903580 30078 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:39:40.903939 30078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:40.904058 30078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:40.904188 30078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:40.911798 30078 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:40.911890 30078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:40.912010 30078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:40.912098 30078 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:40.912209 30078 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:40.922422 30078 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:45491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:38535,127.5.164.253:34059,127.5.164.252:40763
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.252.keytab
--principal=kudu/127.5.164.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.252:40763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.5.164.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:40.923848 30078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:40.925257 30078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:40.937716 30083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:40.937747 30084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:40.937834 30086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:40.938798 30078 server_base.cc:1034] running on GCE node
I20260808 08:39:40.939729 30078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:40.941146 30078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:40.942394 30078 hybrid_clock.cc:648] HybridClock initialized: now 1786178380942298 us; error 49 us; skew 500 ppm
I20260808 08:39:40.942750 30078 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:40 dist-test-slave-chsk krb5kdc[29909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178380, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:40.951267 30078 init.cc:377] Logged in from keytab as kudu/127.5.164.252@KRBTEST.COM (short username kudu)
I20260808 08:39:40.952913 30078 webserver.cc:460] Webserver started at http://127.5.164.252:41279/ using document root <none> and password file <none>
I20260808 08:39:40.953629 30078 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:40.953755 30078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:40.954113 30078 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:40.957293 30078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/data/instance:
uuid: "cbbcd3a4e96a4631a5e53b12297570f9"
format_stamp: "Formatted at 2026-08-08 08:39:40 on dist-test-slave-chsk"
server_key: "c7c2408830bbae697464cca44b0462a2"
server_key_iv: "a16ea496c67cf328cc9937b1bc803451"
server_key_version: "encryptionkey@0"
I20260808 08:39:40.958148 30078 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/wal/instance:
uuid: "cbbcd3a4e96a4631a5e53b12297570f9"
format_stamp: "Formatted at 2026-08-08 08:39:40 on dist-test-slave-chsk"
server_key: "c7c2408830bbae697464cca44b0462a2"
server_key_iv: "a16ea496c67cf328cc9937b1bc803451"
server_key_version: "encryptionkey@0"
I20260808 08:39:40.964151 30078 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260808 08:39:40.967644 30093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:40.969074 30078 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 08:39:40.969274 30078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/wal
uuid: "cbbcd3a4e96a4631a5e53b12297570f9"
format_stamp: "Formatted at 2026-08-08 08:39:40 on dist-test-slave-chsk"
server_key: "c7c2408830bbae697464cca44b0462a2"
server_key_iv: "a16ea496c67cf328cc9937b1bc803451"
server_key_version: "encryptionkey@0"
I20260808 08:39:40.969509 30078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:40.998224 30078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:41.002779 30078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:41.003088 30078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:41.022408 30078 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.252:40763
I20260808 08:39:41.022434 30148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.252:40763 every 8 connection(s)
I20260808 08:39:41.023881 30078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/data/info.pb
I20260808 08:39:41.027446 30149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:41.029819 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 30078
I20260808 08:39:41.030014 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786178004478096-5779-0/minicluster-data/master-2/wal/instance
I20260808 08:39:41.030577 5779 external_mini_cluster.cc:1428] Setting key ede86aa21a9184435e4ee68e612e4888
I20260808 08:39:41.035665 30149 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:39:41 dist-test-slave-chsk krb5kdc[29909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.252@KRBTEST.COM
Aug 08 08:39:41 dist-test-slave-chsk krb5kdc[29909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178380, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.252@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:39:41.054414 30153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:41.038696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51118 (local address 127.5.164.254:38535)
0808 08:39:41.039257 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.039263 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.039752 (+ 489us) server_negotiation.cc:407] Connection header received
0808 08:39:41.039968 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.039972 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.040032 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.040157 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.041358 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.042351 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.043824 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.044504 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.044649 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:41.048234 (+ 3585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:41.048239 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:41.048242 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:41.048284 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:41.051303 (+ 3019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.052138 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.052144 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.052148 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.052316 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.052751 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.052759 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.052765 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.053102 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:41.053244 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:41.053771 (+ 527us) server_negotiation.cc:299] Negotiation successful
0808 08:39:41.054018 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":248,"threads_started":1}
I20260808 08:39:41.054651 30152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:41.032603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44118 (local address 127.5.164.252:40763)
0808 08:39:41.033443 (+ 840us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.033455 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.033502 (+ 47us) server_negotiation.cc:407] Connection header received
0808 08:39:41.035191 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.035223 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.035597 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.035923 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.037782 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.039483 (+ 1701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.040847 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.041733 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.041864 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:41.046689 (+ 4825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:41.046700 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:41.046714 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:41.046752 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:41.050119 (+ 3367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.050944 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.050949 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.050956 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.051091 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.051623 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.051627 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.051629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.052214 (+ 585us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:41.052520 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:41.052992 (+ 472us) server_negotiation.cc:299] Negotiation successful
0808 08:39:41.053405 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":363,"threads_started":1}
I20260808 08:39:41.054741 30154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:41.038751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:38535 (local address 127.0.0.1:51118)
0808 08:39:41.039596 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:41.039659 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:41.039829 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:41.040212 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:41.040220 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:41.040869 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:41.041195 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:41.041207 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.042513 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.042519 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:41.043666 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:41.043678 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.044707 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.044712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:41.044828 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:41.045446 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:41.045476 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:41.048022 (+ 2546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:41.051461 (+ 3439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:41.051473 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:41.051481 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:41.051999 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:41.052436 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:41.052441 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:41.052444 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:41.052601 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:41.053295 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:41.053303 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:41.053472 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 08:39:41.053605 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 08:39:41.053822 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":439,"threads_started":1}
I20260808 08:39:41.056386 30149 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:39:41 dist-test-slave-chsk krb5kdc[29909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178380, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.252@KRBTEST.COM for kudu/127.5.164.253@KRBTEST.COM
Aug 08 08:39:41 dist-test-slave-chsk krb5kdc[29909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:39:41.067718 29993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } attempt: 4
I20260808 08:39:41.071421 30154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:41.057082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:34059 (local address 127.0.0.1:37760)
0808 08:39:41.057279 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:41.057300 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:41.057401 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:41.057753 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:41.057758 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:41.058230 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:41.058430 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:41.058439 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.059480 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.059487 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:41.060349 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:41.060360 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.061075 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.061081 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:41.061288 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:41.061866 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:41.061882 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:41.063904 (+ 2022us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:41.067002 (+ 3098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:41.067008 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:41.067012 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:41.067455 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:41.067918 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:41.067924 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:41.067930 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:41.068108 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:41.070423 (+ 2315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:41.070428 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:41.070577 (+ 149us) client_negotiation.cc:769] Sending connection context
0808 08:39:41.070733 (+ 156us) client_negotiation.cc:240] Negotiation successful
0808 08:39:41.071001 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 08:39:41.071822 30075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:41.057204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37760 (local address 127.5.164.253:34059)
0808 08:39:41.057395 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.057401 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.057419 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:39:41.057542 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.057547 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.057622 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.057730 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.058575 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.059347 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.060492 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.060932 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.061067 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:41.064097 (+ 3030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:41.064102 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:41.064105 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:41.064142 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:41.066875 (+ 2733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.067574 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.067580 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.067583 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.067787 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.068235 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.068239 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.068242 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.068596 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:41.068760 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:41.070854 (+ 2094us) server_negotiation.cc:299] Negotiation successful
0808 08:39:41.071083 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:39:41.072662 30149 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:39:41.073424 30153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:41.058266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51126 (local address 127.5.164.254:38535)
0808 08:39:41.058457 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.058466 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.058485 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:39:41.058542 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.058548 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.058618 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.058718 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.059971 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.060643 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.062005 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.062426 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.062556 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:41.066777 (+ 4221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:41.066785 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:41.066793 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:41.066823 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:41.070259 (+ 3436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.070941 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.070946 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.070949 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.071089 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.071625 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.071629 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.071632 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.072024 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:41.072330 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:41.072791 (+ 461us) server_negotiation.cc:299] Negotiation successful
0808 08:39:41.073083 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 08:39:41 dist-test-slave-chsk krb5kdc[29909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178379, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for kudu/127.5.164.252@KRBTEST.COM
Aug 08 08:39:41 dist-test-slave-chsk krb5kdc[29909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.253@KRBTEST.COM
I20260808 08:39:41.088449 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:41.068394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:44120)
0808 08:39:41.068898 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:41.068912 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:41.069003 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:41.069277 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:41.069280 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:41.069631 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:41.069774 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:41.069781 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.071165 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.071171 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:41.072668 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:41.072681 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.076496 (+ 3815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.076502 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:41.076763 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:41.077471 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:41.077516 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:41.080940 (+ 3424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:41.085202 (+ 4262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:41.085207 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:41.085211 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:41.085839 (+ 628us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:41.086263 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:41.086269 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:41.086274 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:41.086474 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:41.087384 (+ 910us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:41.087389 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:41.087555 (+ 166us) client_negotiation.cc:769] Sending connection context
0808 08:39:41.087722 (+ 167us) client_negotiation.cc:240] Negotiation successful
0808 08:39:41.088031 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400}
I20260808 08:39:41.088444 30152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:41.068717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44120 (local address 127.5.164.252:40763)
0808 08:39:41.068914 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.068922 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.068964 (+ 42us) server_negotiation.cc:407] Connection header received
0808 08:39:41.069087 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.069092 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.069165 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.069274 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.069912 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.070991 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.072864 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.076342 (+ 3478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.076485 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:41.081193 (+ 4708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:41.081200 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:41.081205 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:41.081247 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:41.085067 (+ 3820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.085962 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.085968 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.085971 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.086130 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.086629 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.086634 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.086637 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.087093 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:41.087310 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:41.087834 (+ 524us) server_negotiation.cc:299] Negotiation successful
0808 08:39:41.088100 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":65}
I20260808 08:39:41.092661 30075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:41.075246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37776 (local address 127.5.164.253:34059)
0808 08:39:41.075447 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.075452 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.075468 (+ 16us) server_negotiation.cc:407] Connection header received
0808 08:39:41.075517 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.075520 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.075569 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.075677 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.076827 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.077741 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.078964 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.079577 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.079715 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:41.085590 (+ 5875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:41.085596 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:41.085601 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:41.085647 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:41.089561 (+ 3914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.090556 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.090563 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.090569 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.090737 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.091244 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.091250 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.091253 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.091532 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:41.091817 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:41.092091 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 08:39:41.092321 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
Aug 08 08:39:41 dist-test-slave-chsk krb5kdc[29909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178380, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.252@KRBTEST.COM for kudu/127.5.164.252@KRBTEST.COM
I20260808 08:39:41.094767 29993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf: Bootstrap starting.
I20260808 08:39:41.098937 29993 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:41.100343 29993 log.cc:824] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:41.100469 30154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:41.073396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:44136)
0808 08:39:41.073603 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:41.073619 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:41.073709 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:41.086378 (+ 12669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:41.086382 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:41.086851 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:41.087026 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:41.087035 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.088699 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.088703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:41.089903 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:41.089916 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.090580 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.090586 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:41.090850 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:41.091443 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:41.091466 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:41.093881 (+ 2415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:41.097270 (+ 3389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:41.097277 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:41.097281 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:41.097720 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:41.098465 (+ 745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:41.098470 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:41.098473 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:41.098644 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:41.099415 (+ 771us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:41.099426 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:41.099539 (+ 113us) client_negotiation.cc:769] Sending connection context
0808 08:39:41.099700 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 08:39:41.100039 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60,"mutex_wait_us":21}
I20260808 08:39:41.100714 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 08:39:41.104785 30155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:41.073606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44136 (local address 127.5.164.252:40763)
0808 08:39:41.086081 (+ 12475us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.086086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.086108 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:39:41.086153 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.086159 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.086237 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.086361 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.087227 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.088540 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.090042 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.090425 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.090565 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:41.094114 (+ 3549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:41.094119 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:41.094122 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:41.094150 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:41.097153 (+ 3003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.097838 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.097844 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.097847 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.098345 (+ 498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.098748 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.098755 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.098759 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.099214 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:41.099357 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:41.099794 (+ 437us) server_negotiation.cc:299] Negotiation successful
0808 08:39:41.100213 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":165,"server-negotiator.queue_time_us":12328,"thread_start_us":12966,"threads_started":1}
I20260808 08:39:41.108130 29993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf: No bootstrap required, opened a new log
I20260808 08:39:41.105262 29966 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3d1dc9be2a464d06879897ffe72350bf"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51126
I20260808 08:39:41.110350 30149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9: Bootstrap starting.
I20260808 08:39:41.114193 30149 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:41.115541 30149 log.cc:824] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:41.115873 29993 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } }
I20260808 08:39:41.116345 29993 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1dc9be2a464d06879897ffe72350bf, State: Initialized, Role: FOLLOWER
I20260808 08:39:41.116847 29993 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } }
I20260808 08:39:41.117852 30159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } } }
I20260808 08:39:41.118314 30159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:39:41.119035 30149 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9: No bootstrap required, opened a new log
I20260808 08:39:41.119266 29993 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:41.119443 29966 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 08:39:41.119683 29966 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:41.122625 29966 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } }
I20260808 08:39:41.124441 29966 leader_election.cc:288] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [CANDIDATE]: Term 1 election: Requested vote from peers d7284c4d73f24a2dacd882bf0ba6b618 (127.5.164.253:34059), cbbcd3a4e96a4631a5e53b12297570f9 (127.5.164.252:40763)
I20260808 08:39:41.134692 30149 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } }
I20260808 08:39:41.135762 30149 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbbcd3a4e96a4631a5e53b12297570f9, State: Initialized, Role: FOLLOWER
I20260808 08:39:41.136430 30149 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } }
W20260808 08:39:41.160382 29944 tablet.cc:2369] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:39:41.180573 30172 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } } }
I20260808 08:39:41.181106 30172 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:39:41.182072 30149 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:41.182126 30122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d1dc9be2a464d06879897ffe72350bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "cbbcd3a4e96a4631a5e53b12297570f9"
I20260808 08:39:41.182641 30122 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:41.187662 30122 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1dc9be2a464d06879897ffe72350bf in term 1.
I20260808 08:39:41.189152 30070 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } attempt: 5
I20260808 08:39:41.164320 29922 master_runner.cc:186] Error getting master registration for 127.5.164.253:34059: OK, instance_id { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" instance_seqno: 1786178380453832 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:39:41.191681 29941 leader_election.cc:302] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1dc9be2a464d06879897ffe72350bf, cbbcd3a4e96a4631a5e53b12297570f9; no voters:
I20260808 08:39:41.197835 29922 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 08:39:41.198028 30178 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:39:41.198310 30178 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:39:41.198055 30159 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 08:39:41.199371 30075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:41.135546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37792 (local address 127.5.164.253:34059)
0808 08:39:41.135723 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.135728 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.165707 (+ 29979us) server_negotiation.cc:407] Connection header received
0808 08:39:41.171952 (+ 6245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.171961 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.172070 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.172154 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.176834 (+ 4680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.177986 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.183307 (+ 5321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.184213 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.184386 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:41.189954 (+ 5568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:41.189963 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:41.189971 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:41.190030 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:41.194942 (+ 4912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.196061 (+ 1119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.196070 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.196076 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.196292 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.196863 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.196872 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.196877 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.197395 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:41.197715 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:41.198461 (+ 746us) server_negotiation.cc:299] Negotiation successful
0808 08:39:41.198789 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
Aug 08 08:39:41 dist-test-slave-chsk krb5kdc[29909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178380, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.253@KRBTEST.COM for kudu/127.5.164.252@KRBTEST.COM
I20260808 08:39:41.212605 30155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:41.136853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44150 (local address 127.5.164.252:40763)
0808 08:39:41.137082 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.137100 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.166268 (+ 29168us) server_negotiation.cc:407] Connection header received
0808 08:39:41.169064 (+ 2796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.169073 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.169182 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.169268 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.181401 (+ 12133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.182549 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.184684 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.185417 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.185517 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:41.198446 (+ 12929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:41.198453 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:41.198458 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:41.198497 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:41.203952 (+ 5455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.206841 (+ 2889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.206850 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.206888 (+ 38us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.207268 (+ 380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.208278 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.208286 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.208322 (+ 36us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.209212 (+ 890us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:41.209759 (+ 547us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:41.211062 (+ 1303us) server_negotiation.cc:299] Negotiation successful
0808 08:39:41.211652 (+ 590us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 08:39:41.214596 30153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:41.135451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51140 (local address 127.5.164.254:38535)
0808 08:39:41.135648 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.135654 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.153925 (+ 18271us) server_negotiation.cc:407] Connection header received
0808 08:39:41.154731 (+ 806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.154741 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.154833 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.154910 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.163903 (+ 8993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.165292 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.174603 (+ 9311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.175670 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.175808 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:41.180884 (+ 5076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:41.180891 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:41.180896 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:41.180943 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:41.197660 (+ 16717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.199197 (+ 1537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.199206 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.204102 (+ 4896us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.204340 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.204915 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.204923 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.204929 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.205434 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:41.205800 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:41.213830 (+ 8030us) server_negotiation.cc:299] Negotiation successful
0808 08:39:41.214116 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 08:39:41.228147 30152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:41.190653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44162 (local address 127.5.164.252:40763)
0808 08:39:41.190843 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.190849 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.191161 (+ 312us) server_negotiation.cc:407] Connection header received
0808 08:39:41.191223 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.191227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.191305 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.191400 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.192831 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.193965 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.195981 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.196764 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.196892 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:41.218198 (+ 21306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:41.218208 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:41.218215 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:41.218268 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:41.223344 (+ 5076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.224565 (+ 1221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.224573 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.224579 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.224752 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:41.225311 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:41.225319 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:41.225325 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:41.225899 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:41.226059 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:41.227041 (+ 982us) server_negotiation.cc:299] Negotiation successful
0808 08:39:41.227595 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 08:39:41.229970 30073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:41.189758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:40763 (local address 127.0.0.1:44162)
0808 08:39:41.190173 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:41.190195 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:41.190307 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:41.191698 (+ 1391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:41.191706 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:41.192255 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:41.192457 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:41.192470 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.194158 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.194164 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:41.195697 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:41.195713 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:41.197171 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:41.197181 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:41.197478 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:41.205962 (+ 8484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:41.205987 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:41.217898 (+ 11911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:41.223592 (+ 5694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:41.223599 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:41.223606 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:41.224355 (+ 749us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:41.224910 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:41.224917 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:41.224923 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:41.225157 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:41.226203 (+ 1046us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:41.226211 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:41.226431 (+ 220us) client_negotiation.cc:769] Sending connection context
0808 08:39:41.226607 (+ 176us) client_negotiation.cc:240] Negotiation successful
0808 08:39:41.229405 (+ 2798us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279}
I20260808 08:39:41.236248 30070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618: Bootstrap starting.
I20260808 08:39:41.241968 30070 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:41.243462 30070 log.cc:824] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:41.244180 30159 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [term 1 LEADER]: Becoming Leader. State: Replica: 3d1dc9be2a464d06879897ffe72350bf, State: Running, Role: LEADER
I20260808 08:39:41.244877 30159 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } }
W20260808 08:39:41.245167 30191 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:39:41.245327 30191 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:39:41.252662 30070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618: No bootstrap required, opened a new log
I20260808 08:39:41.253998 30181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d1dc9be2a464d06879897ffe72350bf. Latest consensus state: current_term: 1 leader_uuid: "3d1dc9be2a464d06879897ffe72350bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } } }
I20260808 08:39:41.254484 30181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [sys.catalog]: This master's current role is: LEADER
W20260808 08:39:41.255390 30100 tablet.cc:2369] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:39:41.264660 30070 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } }
I20260808 08:39:41.265143 30070 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7284c4d73f24a2dacd882bf0ba6b618, State: Initialized, Role: FOLLOWER
I20260808 08:39:41.265700 30070 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } }
I20260808 08:39:41.273254 30195 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:41.262517 30078 master_runner.cc:186] Error getting master registration for 127.5.164.253:34059: OK, instance_id { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" instance_seqno: 1786178380453832 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:39:41.274428 30078 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:39:41.274736 30070 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:41.275629 30195 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:41.274770 30044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d1dc9be2a464d06879897ffe72350bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d7284c4d73f24a2dacd882bf0ba6b618"
I20260808 08:39:41.276413 30044 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:41.279919 30044 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1dc9be2a464d06879897ffe72350bf in term 1.
I20260808 08:39:41.272758 30196 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } } }
I20260808 08:39:41.280565 30196 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:39:41.294620 30122 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9 [term 1 FOLLOWER]: Refusing update from remote peer 3d1dc9be2a464d06879897ffe72350bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:39:41.296025 30181 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:39:41.305418 30044 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618 [term 1 FOLLOWER]: Refusing update from remote peer 3d1dc9be2a464d06879897ffe72350bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:39:41.306463 30181 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:39:41.324170 30196 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d1dc9be2a464d06879897ffe72350bf. Latest consensus state: current_term: 1 leader_uuid: "3d1dc9be2a464d06879897ffe72350bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } } }
I20260808 08:39:41.324563 30196 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:39:41.329506 30181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3d1dc9be2a464d06879897ffe72350bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } } }
I20260808 08:39:41.329820 30181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:41.330034 30198 mvcc.cc:205] Tried to move back new op lower bound from 7316186649767411712 to 7316186649586270208. Current Snapshot: MvccSnapshot[applied={T|T < 7316186649767411712}]
I20260808 08:39:41.333493 30195 catalog_manager.cc:1347] Generated new cluster ID: b3f482a36caa475087d986a995f33792
I20260808 08:39:41.333616 30195 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:41.348827 30196 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3d1dc9be2a464d06879897ffe72350bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } } }
I20260808 08:39:41.349174 30196 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:39:41.353425 30172 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d1dc9be2a464d06879897ffe72350bf. Latest consensus state: current_term: 1 leader_uuid: "3d1dc9be2a464d06879897ffe72350bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } } }
I20260808 08:39:41.353773 30172 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:39:41.394387 30211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3d1dc9be2a464d06879897ffe72350bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } } }
I20260808 08:39:41.396267 30172 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3d1dc9be2a464d06879897ffe72350bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1dc9be2a464d06879897ffe72350bf" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 38535 } } peers { permanent_uuid: "d7284c4d73f24a2dacd882bf0ba6b618" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 34059 } } peers { permanent_uuid: "cbbcd3a4e96a4631a5e53b12297570f9" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 40763 } } }
I20260808 08:39:41.396533 30172 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:39:41.399537 30195 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:41.401791 30195 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:41.409592 30211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:41.415527 30195 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d1dc9be2a464d06879897ffe72350bf: Generated new TSK 0
I20260808 08:39:41.416545 30195 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:41.453078 30219 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260808 08:39:41.530232 30075 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:41.519984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37804 (local address 127.5.164.253:34059)
0808 08:39:41.520201 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.520209 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.528160 (+ 7951us) server_negotiation.cc:407] Connection header received
0808 08:39:41.528492 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.528499 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.528593 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.528689 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.529965 (+ 1276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37804: BlockingRecv error: recv got EOF from 127.0.0.1:37804 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 08:39:41.530771 30153 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:41.519654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51146 (local address 127.5.164.254:38535)
0808 08:39:41.520119 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.520126 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.527862 (+ 7736us) server_negotiation.cc:407] Connection header received
0808 08:39:41.529227 (+ 1365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.529234 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.529325 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.529408 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.530534 (+ 1126us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51146: BlockingRecv error: recv got EOF from 127.0.0.1:51146 (error 108)
Metrics: {"server-negotiator.queue_time_us":292}
W20260808 08:39:41.533295 30152 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:41.528443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44174 (local address 127.5.164.252:40763)
0808 08:39:41.528633 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.528640 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.531129 (+ 2489us) server_negotiation.cc:407] Connection header received
0808 08:39:41.531444 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.531453 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.531562 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.531669 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.532970 (+ 1301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44174: BlockingRecv error: recv got EOF from 127.0.0.1:44174 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260808 08:39:41.541119 30075 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:41.538770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37810 (local address 127.5.164.253:34059)
0808 08:39:41.539003 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.539012 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.539555 (+ 543us) server_negotiation.cc:407] Connection header received
0808 08:39:41.539816 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.539821 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.539920 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.540036 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.540802 (+ 766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37810: BlockingRecv error: recv got EOF from 127.0.0.1:37810 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260808 08:39:41.548753 30075 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:41.546294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37812 (local address 127.5.164.253:34059)
0808 08:39:41.546563 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.546573 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.547229 (+ 656us) server_negotiation.cc:407] Connection header received
0808 08:39:41.547496 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.547501 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.547584 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.547706 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.548576 (+ 870us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37812: BlockingRecv error: recv got EOF from 127.0.0.1:37812 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
W20260808 08:39:41.557214 30075 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:41.554798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37826 (local address 127.5.164.253:34059)
0808 08:39:41.555063 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.555074 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.555658 (+ 584us) server_negotiation.cc:407] Connection header received
0808 08:39:41.555910 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.555915 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.556006 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.556128 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.556937 (+ 809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37826: BlockingRecv error: recv got EOF from 127.0.0.1:37826 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260808 08:39:41.566727 30075 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:41.564451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37834 (local address 127.5.164.253:34059)
0808 08:39:41.564721 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.564730 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.565282 (+ 552us) server_negotiation.cc:407] Connection header received
0808 08:39:41.565511 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.565515 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.565588 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.565698 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.566456 (+ 758us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37834: BlockingRecv error: recv got EOF from 127.0.0.1:37834 (error 108)
Metrics: {"server-negotiator.queue_time_us":123}
W20260808 08:39:41.580415 30075 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:41.578243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37846 (local address 127.5.164.253:34059)
0808 08:39:41.578477 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.578486 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.579016 (+ 530us) server_negotiation.cc:407] Connection header received
0808 08:39:41.579281 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.579286 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.579359 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.579468 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.580217 (+ 749us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37846: BlockingRecv error: recv got EOF from 127.0.0.1:37846 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260808 08:39:41.603710 30075 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:41.600947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37856 (local address 127.5.164.253:34059)
0808 08:39:41.601220 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.601232 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.601907 (+ 675us) server_negotiation.cc:407] Connection header received
0808 08:39:41.602209 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.602214 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.602311 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.602437 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.603420 (+ 983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37856: BlockingRecv error: recv got EOF from 127.0.0.1:37856 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
W20260808 08:39:41.641741 30075 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:41.639403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37864 (local address 127.5.164.253:34059)
0808 08:39:41.639638 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.639644 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.640190 (+ 546us) server_negotiation.cc:407] Connection header received
0808 08:39:41.640437 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.640441 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.640525 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.640652 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.641453 (+ 801us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37864: BlockingRecv error: recv got EOF from 127.0.0.1:37864 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260808 08:39:41.717756 30075 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:41.715243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37880 (local address 127.5.164.253:34059)
0808 08:39:41.715472 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.715478 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.716083 (+ 605us) server_negotiation.cc:407] Connection header received
0808 08:39:41.716297 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.716303 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.716410 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.716559 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.717500 (+ 941us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37880: BlockingRecv error: recv got EOF from 127.0.0.1:37880 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
W20260808 08:39:41.852121 30075 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:41.849851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37890 (local address 127.5.164.253:34059)
0808 08:39:41.850077 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:41.850112 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:41.850496 (+ 384us) server_negotiation.cc:407] Connection header received
0808 08:39:41.850765 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:41.850769 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:41.850852 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:41.850975 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:41.851832 (+ 857us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37890: BlockingRecv error: recv got EOF from 127.0.0.1:37890 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 08:39:42.113827 30075 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:42.112173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37894 (local address 127.5.164.253:34059)
0808 08:39:42.112360 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:42.112365 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:42.112592 (+ 227us) server_negotiation.cc:407] Connection header received
0808 08:39:42.112768 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:42.112772 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:42.112850 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:42.112948 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:42.113648 (+ 700us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37894: BlockingRecv error: recv got EOF from 127.0.0.1:37894 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:39:42.247329 30191 catalog_manager.cc:1259] Loaded cluster ID: b3f482a36caa475087d986a995f33792
I20260808 08:39:42.247434 30191 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9: loading cluster ID for follower catalog manager: success
I20260808 08:39:42.249827 30191 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9: acquiring CA information for follower catalog manager: success
I20260808 08:39:42.251521 30191 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cbbcd3a4e96a4631a5e53b12297570f9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:39:42.457463 30219 catalog_manager.cc:1259] Loaded cluster ID: b3f482a36caa475087d986a995f33792
I20260808 08:39:42.457628 30219 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618: loading cluster ID for follower catalog manager: success
I20260808 08:39:42.460392 30219 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618: acquiring CA information for follower catalog manager: success
I20260808 08:39:42.462260 30219 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d7284c4d73f24a2dacd882bf0ba6b618: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:39:42.640802 30288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:42.633003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37900 (local address 127.5.164.253:34059)
0808 08:39:42.634017 (+ 1014us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:42.634022 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:42.634042 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:39:42.634118 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:42.634122 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:42.634282 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:42.634414 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:39:42.634987 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:42.635974 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:42.638007 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:42.638517 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:42.638630 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:42.639373 (+ 743us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:39:42.640041 (+ 668us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:39:42.640164 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:42.640313 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 08:39:42.640408 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":901,"thread_start_us":746,"threads_started":1}
I20260808 08:39:42.661471 30294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:42.654593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44178 (local address 127.5.164.252:40763)
0808 08:39:42.655324 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:42.655329 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:42.655349 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:39:42.655464 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:42.655468 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:42.655645 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:42.655782 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:39:42.656306 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:42.657146 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:42.659065 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:42.659563 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:42.659665 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:42.660245 (+ 580us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:39:42.660747 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:39:42.660857 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:42.661017 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 08:39:42.661114 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":530,"threads_started":1}
I20260808 08:39:42.690641 30300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:42.669556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51158 (local address 127.5.164.254:38535)
0808 08:39:42.680748 (+ 11192us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:42.680756 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:42.680781 (+ 25us) server_negotiation.cc:407] Connection header received
0808 08:39:42.680909 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:42.680915 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:42.681153 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:42.681368 (+ 215us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:39:42.682320 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:42.683898 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:42.686868 (+ 2970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:42.687831 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:42.687970 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:42.689018 (+ 1048us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:39:42.689614 (+ 596us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:39:42.689715 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:42.690017 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 08:39:42.690147 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11043,"thread_start_us":11950,"threads_started":1}
I20260808 08:39:42.691248 30288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:42.669895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37902 (local address 127.5.164.253:34059)
0808 08:39:42.670104 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:42.670111 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:42.682886 (+ 12775us) server_negotiation.cc:407] Connection header received
0808 08:39:42.683269 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:42.683278 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:42.683375 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:42.683442 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:39:42.684436 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:42.685661 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:42.688278 (+ 2617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:42.689017 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:42.689135 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:42.689796 (+ 661us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:39:42.689935 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:39:42.690022 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:42.690786 (+ 764us) server_negotiation.cc:299] Negotiation successful
0808 08:39:42.690883 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260808 08:39:42.697762 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 29922
I20260808 08:39:42.698536 30294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:42.682552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44180 (local address 127.5.164.252:40763)
0808 08:39:42.682761 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:42.682767 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:42.690696 (+ 7929us) server_negotiation.cc:407] Connection header received
0808 08:39:42.692632 (+ 1936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:42.692638 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:42.692742 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:42.692841 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:39:42.693408 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:42.694299 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:42.696383 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:42.697032 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:42.697184 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:42.697732 (+ 548us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:39:42.697885 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:39:42.697987 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:42.698211 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 08:39:42.698312 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 08:39:42.699004 29988 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:39:42.864517 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 29922
W20260808 08:39:42.891990 30095 connection.cc:535] server connection from 127.0.0.1:44120 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 08:39:42.892552 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 30001
I20260808 08:39:42.893690 30065 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:39:43.002290 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 30001
I20260808 08:39:43.026716 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 30078
I20260808 08:39:43.027944 30144 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:39:43.140125 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 30078
2026-08-08T08:39:43Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5198 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 08:39:43 dist-test-slave-chsk krb5kdc[30308](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 08:39:43 dist-test-slave-chsk krb5kdc[30308](info): set up 2 sockets
Aug 08 08:39:43 dist-test-slave-chsk krb5kdc[30308](info): commencing operation
krb5kdc: starting...
W20260808 08:39:44.348169 5779 mini_kdc.cc:121] Time spent starting KDC: real 1.164s user 0.002s sys 0.054s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/test-user.keytab.
Aug 08 08:39:44 dist-test-slave-chsk krb5kdc[30308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T08:39:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T08:39:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.5.164.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
Entry for principal kudu/127.5.164.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab.
I20260808 08:39:44.713027 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:39389
--webserver_interface=127.5.164.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:35305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:39389,127.5.164.253:40279,127.5.164.252:37485
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 08:39:45.058337 30321 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:39:45.058712 30321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:45.058854 30321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:45.058985 30321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:45.066484 30321 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:45.066586 30321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:45.066676 30321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:45.066753 30321 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:45.066844 30321 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:45.077140 30321 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:35305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:39389,127.5.164.253:40279,127.5.164.252:37485
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.254.keytab
--principal=kudu/127.5.164.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.254:39389
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.5.164.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:45.078572 30321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:45.080039 30321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:45.092432 30329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:45.092485 30327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:45.092485 30326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:45.093665 30321 server_base.cc:1034] running on GCE node
I20260808 08:39:45.094496 30321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:45.095963 30321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:45.097209 30321 hybrid_clock.cc:648] HybridClock initialized: now 1786178385097142 us; error 42 us; skew 500 ppm
I20260808 08:39:45.097656 30321 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:45 dist-test-slave-chsk krb5kdc[30308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178385, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:45.101037 30321 init.cc:377] Logged in from keytab as kudu/127.5.164.254@KRBTEST.COM (short username kudu)
I20260808 08:39:45.102478 30321 webserver.cc:460] Webserver started at http://127.5.164.254:45809/ using document root <none> and password file <none>
I20260808 08:39:45.103193 30321 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:45.103303 30321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:45.103587 30321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:45.106657 30321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/data/instance:
uuid: "863539e3dbb5412db87d41881076782d"
format_stamp: "Formatted at 2026-08-08 08:39:45 on dist-test-slave-chsk"
server_key: "6d1bfc6966716321b78b1e6d9459e5f4"
server_key_iv: "dfc7e9db9af0f1e1071e8d6764ff469f"
server_key_version: "encryptionkey@0"
I20260808 08:39:45.107771 30321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/wal/instance:
uuid: "863539e3dbb5412db87d41881076782d"
format_stamp: "Formatted at 2026-08-08 08:39:45 on dist-test-slave-chsk"
server_key: "6d1bfc6966716321b78b1e6d9459e5f4"
server_key_iv: "dfc7e9db9af0f1e1071e8d6764ff469f"
server_key_version: "encryptionkey@0"
I20260808 08:39:45.113030 30321 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260808 08:39:45.116447 30337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:45.117903 30321 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260808 08:39:45.118084 30321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/wal
uuid: "863539e3dbb5412db87d41881076782d"
format_stamp: "Formatted at 2026-08-08 08:39:45 on dist-test-slave-chsk"
server_key: "6d1bfc6966716321b78b1e6d9459e5f4"
server_key_iv: "dfc7e9db9af0f1e1071e8d6764ff469f"
server_key_version: "encryptionkey@0"
I20260808 08:39:45.118309 30321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:45.142072 30321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:45.146742 30321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:45.147043 30321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:45.165911 30321 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.254:39389
I20260808 08:39:45.165946 30394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.254:39389 every 8 connection(s)
I20260808 08:39:45.167315 30321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/data/info.pb
I20260808 08:39:45.168812 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 30321
I20260808 08:39:45.169025 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-0/wal/instance
I20260808 08:39:45.169579 5779 external_mini_cluster.cc:1428] Setting key 4731d6434c5b490b9da13447be73cfde
I20260808 08:39:45.171937 30395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:45.181943 30395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:39:45 dist-test-slave-chsk krb5kdc[30308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178385, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:39:45.206605 30398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.185938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45978 (local address 127.5.164.254:39389)
0808 08:39:45.187371 (+ 1433us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:45.187381 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:45.187443 (+ 62us) server_negotiation.cc:407] Connection header received
0808 08:39:45.189086 (+ 1643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:45.189097 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:45.189405 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:45.189627 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:45.190873 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:45.192846 (+ 1973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:45.194214 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:45.195217 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:45.195459 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:45.199128 (+ 3669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:45.199136 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:45.199199 (+ 63us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:45.199248 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:45.202128 (+ 2880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:45.203088 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:45.203094 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:45.203097 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:45.203315 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:45.203819 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:45.203822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:45.203824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:45.204324 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:45.204478 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:45.205223 (+ 745us) server_negotiation.cc:299] Negotiation successful
0808 08:39:45.205505 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":1164,"spinlock_wait_cycles":11648,"thread_start_us":473,"threads_started":1}
I20260808 08:39:45.206650 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.185939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39389 (local address 127.0.0.1:45978)
0808 08:39:45.186862 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.186917 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:45.188723 (+ 1806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:45.189642 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:45.189647 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:45.190298 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:45.190637 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:45.190655 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:45.193005 (+ 2350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:45.193009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:45.194064 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:45.194076 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:45.195443 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:45.195448 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:45.195592 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:45.196297 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:45.196326 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:45.198885 (+ 2559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:45.202268 (+ 3383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:45.202284 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:45.202298 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:45.202952 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:45.203450 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:45.203459 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:45.203465 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:45.203696 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:45.204496 (+ 800us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:45.204507 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:45.204800 (+ 293us) client_negotiation.cc:769] Sending connection context
0808 08:39:45.205122 (+ 322us) client_negotiation.cc:240] Negotiation successful
0808 08:39:45.205715 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"mutex_wait_us":92,"thread_start_us":430,"threads_started":1}
WARNING: no policy specified for kudu/127.5.164.253@KRBTEST.COM; defaulting to no policy
I20260808 08:39:45.209575 30395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.253@KRBTEST.COM" created.
I20260808 08:39:45.210703 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.210295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:40279 (local address 127.0.0.1:60330)
0808 08:39:45.210469 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.210593 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:40279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 08:39:45.210948 30340 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.164.253:40279: connect: Connection refused (error 111)
I20260808 08:39:45.213757 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.213397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:40279 (local address 127.0.0.1:60336)
0808 08:39:45.213561 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.213632 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:40279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 08:39:45.213940 30395 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.253:40279: Network error: Client connection negotiation failed: client connection to 127.5.164.253:40279: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.253.keytab.
Entry for principal kudu/127.5.164.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.253.keytab.
I20260808 08:39:45.250350 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.253:40279
--webserver_interface=127.5.164.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.253.keytab
--principal=kudu/127.5.164.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:35305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:39389,127.5.164.253:40279,127.5.164.252:37485
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:39:45.263312 30395 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } attempt: 1
I20260808 08:39:45.264555 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.264081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:40279 (local address 127.0.0.1:60342)
0808 08:39:45.264291 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.264418 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:40279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 08:39:45.265568 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.265207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:40279 (local address 127.0.0.1:60344)
0808 08:39:45.265361 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.265438 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:40279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 08:39:45.265828 30395 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.253:40279: Network error: Client connection negotiation failed: client connection to 127.5.164.253:40279: connect: Connection refused (error 111)
I20260808 08:39:45.334113 30395 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } attempt: 2
I20260808 08:39:45.335441 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.334897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:40279 (local address 127.0.0.1:60358)
0808 08:39:45.335180 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.335296 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:40279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 08:39:45.336447 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.336071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:40279 (local address 127.0.0.1:60366)
0808 08:39:45.336242 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.336321 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:40279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 08:39:45.336614 30395 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.253:40279: Network error: Client connection negotiation failed: client connection to 127.5.164.253:40279: connect: Connection refused (error 111)
I20260808 08:39:45.427942 30395 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } attempt: 3
I20260808 08:39:45.429157 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.428721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:40279 (local address 127.0.0.1:60368)
0808 08:39:45.428924 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.429020 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:40279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 08:39:45.430222 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.429844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:40279 (local address 127.0.0.1:60370)
0808 08:39:45.430002 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.430077 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:40279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 08:39:45.430395 30395 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.253:40279: Network error: Client connection negotiation failed: client connection to 127.5.164.253:40279: connect: Connection refused (error 111)
I20260808 08:39:45.573644 30395 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } attempt: 4
I20260808 08:39:45.574872 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.574337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:40279 (local address 127.0.0.1:60384)
0808 08:39:45.574648 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.574740 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:40279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
I20260808 08:39:45.575879 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.575525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:40279 (local address 127.0.0.1:60396)
0808 08:39:45.575667 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.575756 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.253:40279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 08:39:45.576045 30395 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.253:40279: Network error: Client connection negotiation failed: client connection to 127.5.164.253:40279: connect: Connection refused (error 111)
W20260808 08:39:45.594393 30402 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:39:45.594762 30402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:45.594880 30402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:45.595041 30402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:45.602349 30402 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:45.602470 30402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:45.602566 30402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:45.602662 30402 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:45.602751 30402 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:45.612597 30402 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:35305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:39389,127.5.164.253:40279,127.5.164.252:37485
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.253.keytab
--principal=kudu/127.5.164.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.253:40279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.5.164.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:45.613983 30402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:45.615362 30402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:45.627161 30410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:45.627298 30408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:45.627271 30407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:45.628065 30402 server_base.cc:1034] running on GCE node
I20260808 08:39:45.628916 30402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:45.630326 30402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:45.631579 30402 hybrid_clock.cc:648] HybridClock initialized: now 1786178385631507 us; error 47 us; skew 500 ppm
I20260808 08:39:45.631932 30402 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:45 dist-test-slave-chsk krb5kdc[30308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178385, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:45.635274 30402 init.cc:377] Logged in from keytab as kudu/127.5.164.253@KRBTEST.COM (short username kudu)
I20260808 08:39:45.636690 30402 webserver.cc:460] Webserver started at http://127.5.164.253:45323/ using document root <none> and password file <none>
I20260808 08:39:45.637365 30402 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:45.637454 30402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:45.637725 30402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:45.640844 30402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/data/instance:
uuid: "86092287932843dfa30859deb678ef52"
format_stamp: "Formatted at 2026-08-08 08:39:45 on dist-test-slave-chsk"
server_key: "78911b00423d1dc61b80e5f84e047ece"
server_key_iv: "4a85b28363959a3e7374b1777ef8f558"
server_key_version: "encryptionkey@0"
I20260808 08:39:45.641673 30402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/wal/instance:
uuid: "86092287932843dfa30859deb678ef52"
format_stamp: "Formatted at 2026-08-08 08:39:45 on dist-test-slave-chsk"
server_key: "78911b00423d1dc61b80e5f84e047ece"
server_key_iv: "4a85b28363959a3e7374b1777ef8f558"
server_key_version: "encryptionkey@0"
I20260808 08:39:45.646965 30402 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260808 08:39:45.650413 30417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:45.651870 30402 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 08:39:45.652055 30402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/wal
uuid: "86092287932843dfa30859deb678ef52"
format_stamp: "Formatted at 2026-08-08 08:39:45 on dist-test-slave-chsk"
server_key: "78911b00423d1dc61b80e5f84e047ece"
server_key_iv: "4a85b28363959a3e7374b1777ef8f558"
server_key_version: "encryptionkey@0"
I20260808 08:39:45.652251 30402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:45.681267 30402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:45.685806 30402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:45.686044 30402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:45.704362 30402 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.253:40279
I20260808 08:39:45.704383 30470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.253:40279 every 8 connection(s)
I20260808 08:39:45.705703 30402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/data/info.pb
I20260808 08:39:45.709481 30471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:45.715510 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 30402
I20260808 08:39:45.715737 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-1/wal/instance
I20260808 08:39:45.716310 5779 external_mini_cluster.cc:1428] Setting key 52bb312a681737ec31aacfd2642e54e4
I20260808 08:39:45.716282 30471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:39:45 dist-test-slave-chsk krb5kdc[30308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178385, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.253@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:39:45.744138 30473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.719702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45980 (local address 127.5.164.254:39389)
0808 08:39:45.720252 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:45.720260 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:45.721270 (+ 1010us) server_negotiation.cc:407] Connection header received
0808 08:39:45.724150 (+ 2880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:45.724154 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:45.724234 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:45.724328 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:45.726418 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:45.727124 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:45.729553 (+ 2429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:45.730302 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:45.730442 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:45.735482 (+ 5040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:45.735489 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:45.735494 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:45.735548 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:45.739095 (+ 3547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:45.740183 (+ 1088us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:45.740189 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:45.740193 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:45.740363 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:45.740929 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:45.740936 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:45.740942 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:45.741384 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:45.741565 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:45.743332 (+ 1767us) server_negotiation.cc:299] Negotiation successful
0808 08:39:45.743626 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":256,"threads_started":1}
I20260808 08:39:45.745978 30474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.720260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39389 (local address 127.0.0.1:45980)
0808 08:39:45.721077 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.721126 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:45.723849 (+ 2723us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:45.724594 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:45.724607 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:45.725435 (+ 828us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:45.726202 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:45.726229 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:45.727336 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:45.727344 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:45.729355 (+ 2011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:45.729374 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:45.730757 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:45.730767 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:45.731121 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:45.731997 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:45.732046 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:45.735132 (+ 3086us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:45.739297 (+ 4165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:45.739310 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:45.739332 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:45.739977 (+ 645us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:45.740506 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:45.740514 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:45.740521 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:45.740780 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:45.741661 (+ 881us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:45.741673 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:45.742209 (+ 536us) client_negotiation.cc:769] Sending connection context
0808 08:39:45.742532 (+ 323us) client_negotiation.cc:240] Negotiation successful
0808 08:39:45.744346 (+ 1814us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":300,"threads_started":1}
I20260808 08:39:45.748458 30471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:39:45 dist-test-slave-chsk krb5kdc[30308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178385, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.253@KRBTEST.COM for kudu/127.5.164.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.5.164.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.5.164.252@KRBTEST.COM" created.
I20260808 08:39:45.765312 30474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.749314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:40279 (local address 127.0.0.1:60400)
0808 08:39:45.749581 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.749603 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:45.749719 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:45.750656 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:45.750664 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:45.751232 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:45.751453 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:45.751468 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:45.752873 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:45.752881 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:45.754476 (+ 1595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:45.754495 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:45.755367 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:45.755376 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:45.755612 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:45.756297 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:45.756324 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:45.758930 (+ 2606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:45.762581 (+ 3651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:45.762584 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:45.762626 (+ 42us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:45.763034 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:45.763555 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:45.763558 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:45.763561 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:45.763680 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:45.764330 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:45.764335 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:45.764468 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 08:39:45.764609 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 08:39:45.764903 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 08:39:45.765394 30477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.749516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60400 (local address 127.5.164.253:40279)
0808 08:39:45.750231 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:45.750237 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:45.750264 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:39:45.750310 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:45.750316 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:45.750487 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:45.750598 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:45.751635 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:45.752727 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:45.754621 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:45.755134 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:45.755303 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:45.759194 (+ 3891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:45.759210 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:45.759229 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:45.759266 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:45.762459 (+ 3193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:45.763253 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:45.763264 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:45.763267 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:45.763419 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:45.763797 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:45.763805 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:45.763808 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:45.764171 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:45.764398 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:45.764760 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 08:39:45.765023 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":551,"thread_start_us":409,"threads_started":1}
I20260808 08:39:45.767755 30471 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:39:45.769021 30474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.768556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:51998)
0808 08:39:45.768721 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.768861 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 08:39:45.769273 30421 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
I20260808 08:39:45.770803 30474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.770474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52010)
0808 08:39:45.770625 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.770697 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 08:39:45.771037 30471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:37485: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.5.164.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.252.keytab.
Entry for principal kudu/127.5.164.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.252.keytab.
I20260808 08:39:45.802951 5779 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
/tmp/dist-test-taskp0Id9M/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.252:37485
--webserver_interface=127.5.164.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.252.keytab
--principal=kudu/127.5.164.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.5.164.212:35305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.5.164.254:39389,127.5.164.253:40279,127.5.164.252:37485
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 08:39:45.820401 30471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } attempt: 1
I20260808 08:39:45.821807 30474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.821281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52014)
0808 08:39:45.821492 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.821620 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 08:39:45.823036 30474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.822542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52024)
0808 08:39:45.822739 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.822883 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 08:39:45.823308 30471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:37485: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
I20260808 08:39:45.875291 30395 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } attempt: 5
Aug 08 08:39:45 dist-test-slave-chsk krb5kdc[30308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178385, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for kudu/127.5.164.253@KRBTEST.COM
I20260808 08:39:45.891263 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.876125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:40279 (local address 127.0.0.1:60410)
0808 08:39:45.876360 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.876385 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:45.876518 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:45.877043 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:45.877047 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:45.877489 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:45.877690 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:45.877700 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:45.879273 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:45.879278 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:45.880187 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:45.880202 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:45.881222 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:45.881228 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:45.881435 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:45.882192 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:45.882212 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:45.884710 (+ 2498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:45.888684 (+ 3974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:45.888689 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:45.888691 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:45.889100 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:45.889537 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:45.889541 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:45.889543 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:45.889687 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:45.890345 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:45.890349 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:45.890507 (+ 158us) client_negotiation.cc:769] Sending connection context
0808 08:39:45.890639 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 08:39:45.890904 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 08:39:45.891402 30477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.876243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60410 (local address 127.5.164.253:40279)
0808 08:39:45.876442 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:45.876448 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:45.876475 (+ 27us) server_negotiation.cc:407] Connection header received
0808 08:39:45.876680 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:45.876686 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:45.876782 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:45.876915 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:45.877897 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:45.879008 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:45.880362 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:45.881032 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:45.881183 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:45.884931 (+ 3748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:45.884937 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:45.884944 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:45.884986 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:45.888523 (+ 3537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:45.889232 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:45.889238 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:45.889242 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:45.889406 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:45.889795 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:45.889800 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:45.889803 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:45.890174 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:45.890332 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:45.890787 (+ 455us) server_negotiation.cc:299] Negotiation successful
0808 08:39:45.891053 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 08:39:45.891711 30471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } attempt: 2
I20260808 08:39:45.892442 30395 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:39:45.892766 30474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.892298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52026)
0808 08:39:45.892506 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.892614 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 08:39:45.893905 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.893261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52040)
0808 08:39:45.893699 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.893772 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 08:39:45.893910 30474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.893525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52044)
0808 08:39:45.893678 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.893775 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 08:39:45.894136 30471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:37485: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
I20260808 08:39:45.894955 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.894632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52058)
0808 08:39:45.894781 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.894863 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 08:39:45.895205 30395 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:37485: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
I20260808 08:39:45.946452 30395 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } attempt: 1
I20260808 08:39:45.947839 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.947245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52074)
0808 08:39:45.947479 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.947604 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 08:39:45.948944 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.948550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52084)
0808 08:39:45.948714 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.948808 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 08:39:45.949208 30395 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:37485: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
I20260808 08:39:45.985368 30471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } attempt: 3
I20260808 08:39:45.986721 30474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.986140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52088)
0808 08:39:45.986393 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.986508 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 08:39:45.987936 30474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:45.987440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52102)
0808 08:39:45.987679 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:45.987785 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
W20260808 08:39:45.988212 30471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:37485: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
I20260808 08:39:46.017449 30395 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } attempt: 2
I20260808 08:39:46.018909 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.018165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52112)
0808 08:39:46.018478 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:46.018622 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260808 08:39:46.020210 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.019702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52118)
0808 08:39:46.019924 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:46.020039 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 08:39:46.020502 30395 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:37485: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
I20260808 08:39:46.126781 30395 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } attempt: 3
I20260808 08:39:46.128185 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.127523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52120)
0808 08:39:46.127792 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:46.127946 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260808 08:39:46.129354 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.128888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52124)
0808 08:39:46.129112 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:46.129206 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260808 08:39:46.129587 30395 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:37485: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
I20260808 08:39:46.131428 30471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } attempt: 4
I20260808 08:39:46.132618 30474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.132043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52136)
0808 08:39:46.132319 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:46.132431 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260808 08:39:46.133987 30474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.133555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52138)
0808 08:39:46.133743 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:46.133840 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 08:39:46.134223 30471 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.5.164.252:37485: Network error: Client connection negotiation failed: client connection to 127.5.164.252:37485: connect: Connection refused (error 111)
W20260808 08:39:46.162743 30480 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 08:39:46.163093 30480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 08:39:46.163229 30480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 08:39:46.163331 30480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 08:39:46.170814 30480 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 08:39:46.170912 30480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 08:39:46.170998 30480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 08:39:46.171103 30480 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 08:39:46.171262 30480 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 08:39:46.181572 30480 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.5.164.212:35305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.5.164.254:39389,127.5.164.253:40279,127.5.164.252:37485
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/krb5kdc/kudu_127.5.164.252.keytab
--principal=kudu/127.5.164.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.5.164.252:37485
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.5.164.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 08 Aug 2026 06:14:21 UTC on ccycloud.quasar-iagljp.root.comops.site
build id 4574103
ASAN enabled
I20260808 08:39:46.182977 30480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 08:39:46.184378 30480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 08:39:46.196338 30486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:46.196262 30489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 08:39:46.196305 30487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 08:39:46.197188 30480 server_base.cc:1034] running on GCE node
I20260808 08:39:46.197973 30480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 08:39:46.199486 30480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 08:39:46.200737 30480 hybrid_clock.cc:648] HybridClock initialized: now 1786178386200654 us; error 54 us; skew 500 ppm
I20260808 08:39:46.201082 30480 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 08 08:39:46 dist-test-slave-chsk krb5kdc[30308](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178386, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 08:39:46.208642 30480 init.cc:377] Logged in from keytab as kudu/127.5.164.252@KRBTEST.COM (short username kudu)
I20260808 08:39:46.210388 30480 webserver.cc:460] Webserver started at http://127.5.164.252:33945/ using document root <none> and password file <none>
I20260808 08:39:46.211186 30480 fs_manager.cc:359] Metadata directory not provided
I20260808 08:39:46.211339 30480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 08:39:46.211686 30480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 08:39:46.214819 30480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/data/instance:
uuid: "5c00dfe762f545988dc95d959cc586ed"
format_stamp: "Formatted at 2026-08-08 08:39:46 on dist-test-slave-chsk"
server_key: "cb8bbdbd439d6298e8e5433182e022c8"
server_key_iv: "4866c1467d5b721a4b5dfa1dd8473345"
server_key_version: "encryptionkey@0"
I20260808 08:39:46.215668 30480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/wal/instance:
uuid: "5c00dfe762f545988dc95d959cc586ed"
format_stamp: "Formatted at 2026-08-08 08:39:46 on dist-test-slave-chsk"
server_key: "cb8bbdbd439d6298e8e5433182e022c8"
server_key_iv: "4866c1467d5b721a4b5dfa1dd8473345"
server_key_version: "encryptionkey@0"
I20260808 08:39:46.221132 30480 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 08:39:46.224721 30497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 08:39:46.226040 30480 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 08:39:46.226234 30480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/data,/tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/wal
uuid: "5c00dfe762f545988dc95d959cc586ed"
format_stamp: "Formatted at 2026-08-08 08:39:46 on dist-test-slave-chsk"
server_key: "cb8bbdbd439d6298e8e5433182e022c8"
server_key_iv: "4866c1467d5b721a4b5dfa1dd8473345"
server_key_version: "encryptionkey@0"
I20260808 08:39:46.226473 30480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 08:39:46.264240 30480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 08:39:46.268602 30480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 08:39:46.268920 30480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 08:39:46.288245 30480 rpc_server.cc:307] RPC server started. Bound to: 127.5.164.252:37485
I20260808 08:39:46.288275 30550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.5.164.252:37485 every 8 connection(s)
I20260808 08:39:46.289662 30480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/data/info.pb
I20260808 08:39:46.291419 5779 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu as pid 30480
I20260808 08:39:46.291618 5779 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskp0Id9M/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786178004478096-5779-0/minicluster-data/master-2/wal/instance
I20260808 08:39:46.292075 5779 external_mini_cluster.cc:1428] Setting key e1a1979769b748b2c2cf691ba8ca08e2
I20260808 08:39:46.293716 30551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 08:39:46.303195 30551 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:39:46.307132 30395 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } attempt: 4
Aug 08 08:39:46 dist-test-slave-chsk krb5kdc[30308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.252@KRBTEST.COM
Aug 08 08:39:46 dist-test-slave-chsk krb5kdc[30308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178385, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.254@KRBTEST.COM for kudu/127.5.164.252@KRBTEST.COM
Aug 08 08:39:46 dist-test-slave-chsk krb5kdc[30308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178386, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.252@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:39:46.318948 30554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.293899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52146 (local address 127.5.164.252:37485)
0808 08:39:46.294688 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.294706 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.294755 (+ 49us) server_negotiation.cc:407] Connection header received
0808 08:39:46.296852 (+ 2097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.296878 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.297393 (+ 515us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.297847 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.299240 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.301260 (+ 2020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.302500 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.303581 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.303766 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:46.308840 (+ 5074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:46.308850 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:46.308863 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:46.308915 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:46.313323 (+ 4408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.314037 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.314045 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.314053 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.314231 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.314963 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.314968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.314971 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.315776 (+ 805us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:46.316080 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:46.316984 (+ 904us) server_negotiation.cc:299] Negotiation successful
0808 08:39:46.317425 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"spinlock_wait_cycles":21888,"thread_start_us":346,"threads_started":1}
I20260808 08:39:46.325356 30556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.306036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45986 (local address 127.5.164.254:39389)
0808 08:39:46.307741 (+ 1705us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.307748 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.307766 (+ 18us) server_negotiation.cc:407] Connection header received
0808 08:39:46.307826 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.307832 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.307943 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.309326 (+ 1383us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.311039 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.311971 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.313532 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.314299 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.314413 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:46.318267 (+ 3854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:46.318272 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:46.318275 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:46.318304 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:46.321869 (+ 3565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.322913 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.322916 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.322918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.323069 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.323501 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.323506 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.323510 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.323937 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:46.324083 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:46.324636 (+ 553us) server_negotiation.cc:299] Negotiation successful
0808 08:39:46.324873 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":1583,"thread_start_us":1440,"threads_started":1}
I20260808 08:39:46.325659 30555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.305993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.254:39389 (local address 127.0.0.1:45986)
0808 08:39:46.306903 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:46.306962 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:46.307198 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:46.308183 (+ 985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:46.308195 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:46.309289 (+ 1094us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:46.309706 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:46.309718 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.312153 (+ 2435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.312158 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:46.313364 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:46.313375 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.314463 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.314468 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:46.314728 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:46.315543 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:46.315571 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:46.318066 (+ 2495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:46.322083 (+ 4017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:46.322094 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:46.322100 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:46.322794 (+ 694us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:46.323237 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:46.323242 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:46.323246 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:46.323386 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:46.324097 (+ 711us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:46.324106 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:46.324320 (+ 214us) client_negotiation.cc:769] Sending connection context
0808 08:39:46.324537 (+ 217us) client_negotiation.cc:240] Negotiation successful
0808 08:39:46.324921 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"mutex_wait_us":74,"thread_start_us":366,"threads_started":1}
I20260808 08:39:46.326583 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.307807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52158)
0808 08:39:46.308078 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:46.308097 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:46.308200 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:46.309053 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:46.309058 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:46.309571 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:46.309759 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:46.309772 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.311540 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.311548 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:46.313121 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:46.313137 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.314081 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.314090 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:46.314352 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:46.315021 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:46.315043 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:46.318138 (+ 3095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:46.323844 (+ 5706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:46.323848 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:46.323852 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:46.324312 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:46.324739 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:46.324744 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:46.324747 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:46.324885 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:46.325601 (+ 716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:46.325606 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:46.325770 (+ 164us) client_negotiation.cc:769] Sending connection context
0808 08:39:46.325912 (+ 142us) client_negotiation.cc:240] Negotiation successful
0808 08:39:46.326155 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":1}
I20260808 08:39:46.327327 30551 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } has no permanent_uuid. Determining permanent_uuid...
I20260808 08:39:46.327575 30557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.307985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52158 (local address 127.5.164.252:37485)
0808 08:39:46.308779 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.308787 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.308808 (+ 21us) server_negotiation.cc:407] Connection header received
0808 08:39:46.308847 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.308850 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.308904 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.309032 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.309985 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.311363 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.313298 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.313912 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.314626 (+ 714us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:46.318388 (+ 3762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:46.318394 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:46.318399 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:46.318432 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:46.323664 (+ 5232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.324436 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.324441 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.324445 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.324610 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.325041 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.325046 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.325049 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.325413 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:46.326818 (+ 1405us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:46.326950 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 08:39:46.327126 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":137,"server-negotiator.queue_time_us":640,"thread_start_us":459,"threads_started":1}
Aug 08 08:39:46 dist-test-slave-chsk krb5kdc[30308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.254@KRBTEST.COM
I20260808 08:39:46.334161 30395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d: Bootstrap starting.
Aug 08 08:39:46 dist-test-slave-chsk krb5kdc[30308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178386, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.252@KRBTEST.COM for kudu/127.5.164.253@KRBTEST.COM
I20260808 08:39:46.338559 30395 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:46.340093 30558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.321982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45994 (local address 127.5.164.254:39389)
0808 08:39:46.322824 (+ 842us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.322831 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.322857 (+ 26us) server_negotiation.cc:407] Connection header received
0808 08:39:46.322909 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.322914 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.322986 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.324779 (+ 1793us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.325090 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.326411 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.328110 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.328670 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.328809 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:46.333237 (+ 4428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:46.333244 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:46.333249 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:46.333288 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:46.336992 (+ 3704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.337732 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.337738 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.337743 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.337878 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.338467 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.338474 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.338476 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.338826 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:46.339110 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:46.339479 (+ 369us) server_negotiation.cc:299] Negotiation successful
0808 08:39:46.339696 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":524,"threads_started":1}
I20260808 08:39:46.340260 30395 log.cc:824] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:46.343377 30477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.328113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60424 (local address 127.5.164.253:40279)
0808 08:39:46.328267 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.328272 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.328451 (+ 179us) server_negotiation.cc:407] Connection header received
0808 08:39:46.328703 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.328721 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.328811 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.328891 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.329931 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.330945 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.332688 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.333303 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.333442 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:46.336499 (+ 3057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:46.336504 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:46.336507 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:46.336553 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:46.340051 (+ 3498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.340892 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.340900 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.340906 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.341090 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.341755 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.341761 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.341764 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.342146 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:46.342281 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:46.342738 (+ 457us) server_negotiation.cc:299] Negotiation successful
0808 08:39:46.342959 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 08:39:46.343775 30395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d: No bootstrap required, opened a new log
I20260808 08:39:46.344148 30555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.328012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.253:40279 (local address 127.0.0.1:60424)
0808 08:39:46.328349 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:46.328386 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:46.328548 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:46.329110 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:46.329114 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:46.329556 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:46.329754 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:46.329765 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.331183 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.331188 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:46.332526 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:46.332540 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.333453 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.333458 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:46.333676 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:46.334221 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:46.334246 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:46.336315 (+ 2069us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:46.340208 (+ 3893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:46.340212 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:46.340217 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:46.340730 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:46.341493 (+ 763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:46.341497 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:46.341499 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:46.341631 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:46.342255 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:46.342260 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:46.342433 (+ 173us) client_negotiation.cc:769] Sending connection context
0808 08:39:46.343618 (+ 1185us) client_negotiation.cc:240] Negotiation successful
0808 08:39:46.343903 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 08:39:46.345193 30551 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 08:39:46 dist-test-slave-chsk krb5kdc[30308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178384, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.5.164.253@KRBTEST.COM
I20260808 08:39:46.353782 30395 raft_consensus.cc:348] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } }
I20260808 08:39:46.354125 30395 raft_consensus.cc:729] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 863539e3dbb5412db87d41881076782d, State: Initialized, Role: FOLLOWER
Aug 08 08:39:46 dist-test-slave-chsk krb5kdc[30308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178386, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.252@KRBTEST.COM for kudu/127.5.164.252@KRBTEST.COM
I20260808 08:39:46.354647 30395 consensus_queue.cc:260] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } }
I20260808 08:39:46.355624 30562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } } }
I20260808 08:39:46.356096 30562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:39:46.357221 30395 sys_catalog.cc:564] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:46.361222 30560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.342143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60434 (local address 127.5.164.253:40279)
0808 08:39:46.342685 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.342693 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.342728 (+ 35us) server_negotiation.cc:407] Connection header received
0808 08:39:46.342771 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.342775 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.342836 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.342939 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.344983 (+ 2044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.346147 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.348082 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.348565 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.348659 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:46.354183 (+ 5524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:46.354188 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:46.354191 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:46.354222 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:46.357892 (+ 3670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.358713 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.358719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.358723 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.358876 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.359421 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.359429 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.359434 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.359786 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:46.360034 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:46.360620 (+ 586us) server_negotiation.cc:299] Negotiation successful
0808 08:39:46.360867 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":234,"threads_started":1}
I20260808 08:39:46.362811 30557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.346414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52172 (local address 127.5.164.252:37485)
0808 08:39:46.346642 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.346650 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.347487 (+ 837us) server_negotiation.cc:407] Connection header received
0808 08:39:46.347722 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.347729 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.347807 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.347881 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.349572 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.350249 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.351400 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.351804 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.351937 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:46.355881 (+ 3944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:46.355889 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:46.355896 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:46.355931 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:46.359108 (+ 3177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.359898 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.359903 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.359906 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.360042 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.360483 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.360492 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.360497 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.361218 (+ 721us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:46.361411 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:46.361987 (+ 576us) server_negotiation.cc:299] Negotiation successful
0808 08:39:46.362378 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 08:39:46.362540 30555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.345975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52172)
0808 08:39:46.347396 (+ 1421us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:46.347420 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:46.347579 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:46.348846 (+ 1267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:46.348849 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:46.349237 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:46.349448 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:46.349463 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.350371 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.350379 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:46.351266 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:46.351277 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.351956 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.351961 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:46.352150 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:46.352699 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:46.352737 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:46.355677 (+ 2940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:46.359269 (+ 3592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:46.359273 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:46.359276 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:46.359783 (+ 507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:46.360169 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:46.360173 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:46.360176 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:46.360329 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:46.361446 (+ 1117us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:46.361451 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:46.361610 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 08:39:46.361800 (+ 190us) client_negotiation.cc:240] Negotiation successful
0808 08:39:46.362125 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1301,"thread_start_us":2089,"threads_started":1}
I20260808 08:39:46.369526 30551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed: Bootstrap starting.
I20260808 08:39:46.370818 5779 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260808 08:39:46.371011 30573 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 08:39:46.371168 30573 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 08:39:46.373087 30551 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:46.374104 30366 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "863539e3dbb5412db87d41881076782d"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45994
I20260808 08:39:46.374414 30551 log.cc:824] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:46.374521 30366 raft_consensus.cc:482] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 08:39:46.374716 30366 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:46.377699 30551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed: No bootstrap required, opened a new log
I20260808 08:39:46.378302 30366 raft_consensus.cc:504] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } }
I20260808 08:39:46.379904 30366 leader_election.cc:288] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [CANDIDATE]: Term 1 election: Requested vote from peers 86092287932843dfa30859deb678ef52 (127.5.164.253:40279), 5c00dfe762f545988dc95d959cc586ed (127.5.164.252:37485)
I20260808 08:39:46.370615 30321 master_runner.cc:186] Error getting master registration for 127.5.164.253:40279: OK, instance_id { permanent_uuid: "86092287932843dfa30859deb678ef52" instance_seqno: 1786178385699308 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:39:46.389605 30551 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } }
I20260808 08:39:46.390043 30551 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c00dfe762f545988dc95d959cc586ed, State: Initialized, Role: FOLLOWER
I20260808 08:39:46.390246 30321 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:39:46.390597 30551 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } }
I20260808 08:39:46.392071 30579 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } } }
I20260808 08:39:46.393060 30579 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:39:46.393182 30525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "863539e3dbb5412db87d41881076782d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5c00dfe762f545988dc95d959cc586ed"
I20260808 08:39:46.393718 30525 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:46.396937 30525 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 863539e3dbb5412db87d41881076782d in term 1.
I20260808 08:39:46.393131 30551 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:46.397660 30341 leader_election.cc:302] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c00dfe762f545988dc95d959cc586ed, 863539e3dbb5412db87d41881076782d; no voters:
I20260808 08:39:46.398164 30562 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [term 1 FOLLOWER]: Leader election won for term 1
W20260808 08:39:46.400110 30343 tablet.cc:2369] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 08:39:46.401059 30562 raft_consensus.cc:686] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [term 1 LEADER]: Becoming Leader. State: Replica: 863539e3dbb5412db87d41881076782d, State: Running, Role: LEADER
I20260808 08:39:46.401664 30562 consensus_queue.cc:237] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } }
I20260808 08:39:46.409516 30582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 863539e3dbb5412db87d41881076782d. Latest consensus state: current_term: 1 leader_uuid: "863539e3dbb5412db87d41881076782d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } } }
I20260808 08:39:46.409951 30582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:46.411460 30586 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 08:39:46.423475 30586 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 08:39:46.433434 30471 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } attempt: 5
Aug 08 08:39:46 dist-test-slave-chsk krb5kdc[30308](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786178385, etypes {rep=17 tkt=17 ses=17}, kudu/127.5.164.253@KRBTEST.COM for kudu/127.5.164.252@KRBTEST.COM
I20260808 08:39:46.454861 30525 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed [term 1 FOLLOWER]: Refusing update from remote peer 863539e3dbb5412db87d41881076782d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:39:46.456610 30582 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:39:46.470141 30560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.415442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60440 (local address 127.5.164.253:40279)
0808 08:39:46.416193 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.416199 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.416218 (+ 19us) server_negotiation.cc:407] Connection header received
0808 08:39:46.416276 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.416280 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.416349 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.416449 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.419533 (+ 3084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.421004 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.424286 (+ 3282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.425201 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.425326 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:46.430075 (+ 4749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:46.430085 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:46.430093 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:46.430151 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:46.449510 (+ 19359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.466049 (+ 16539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.466060 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.466066 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.466305 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.466884 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.466893 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.466899 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.467443 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:46.467788 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:46.469281 (+ 1493us) server_negotiation.cc:299] Negotiation successful
0808 08:39:46.469615 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559}
I20260808 08:39:46.480772 30474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.434195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.5.164.252:37485 (local address 127.0.0.1:52182)
0808 08:39:46.434728 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0808 08:39:46.434754 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 08:39:46.434885 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 08:39:46.435974 (+ 1089us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 08:39:46.435983 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 08:39:46.436634 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0808 08:39:46.436912 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:46.436928 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.438868 (+ 1940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.438876 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:46.440831 (+ 1955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 08:39:46.440850 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.442422 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.442431 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 08:39:46.442769 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:46.443621 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 08:39:46.443656 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0808 08:39:46.448034 (+ 4378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 08:39:46.468545 (+ 20511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:46.468552 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:46.468580 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:46.469491 (+ 911us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:46.470719 (+ 1228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 08:39:46.470724 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 08:39:46.470728 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 08:39:46.471024 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 08:39:46.474631 (+ 3607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 08:39:46.474636 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 08:39:46.474915 (+ 279us) client_negotiation.cc:769] Sending connection context
0808 08:39:46.475234 (+ 319us) client_negotiation.cc:240] Negotiation successful
0808 08:39:46.476246 (+ 1012us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348}
I20260808 08:39:46.486567 30558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.415238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46004 (local address 127.5.164.254:39389)
0808 08:39:46.415639 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.415646 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.415668 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:39:46.415751 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.415755 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.415836 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.415948 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.431465 (+ 15517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.432622 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.443471 (+ 10849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.448475 (+ 5004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.448644 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:46.456593 (+ 7949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:46.456601 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:46.456606 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:46.456669 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:46.460977 (+ 4308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.475831 (+ 14854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.475839 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.475843 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.476038 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.478887 (+ 2849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.478895 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.478898 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.479339 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:46.479594 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:46.485914 (+ 6320us) server_negotiation.cc:299] Negotiation successful
0808 08:39:46.486212 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273}
I20260808 08:39:46.490073 30579 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 863539e3dbb5412db87d41881076782d. Latest consensus state: current_term: 1 leader_uuid: "863539e3dbb5412db87d41881076782d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } } }
I20260808 08:39:46.490916 30579 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:39:46.491466 30554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.435163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52182 (local address 127.5.164.252:37485)
0808 08:39:46.435396 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.435404 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.435427 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:39:46.435501 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.435509 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.435608 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.435735 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.437139 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.438644 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.441052 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.441980 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.442151 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:46.449795 (+ 7644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:46.449805 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:46.449813 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:46.449871 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:46.468305 (+ 18434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.469802 (+ 1497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.469807 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.469811 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.470331 (+ 520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.471607 (+ 1276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.471613 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.471616 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.474041 (+ 2425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:46.476819 (+ 2778us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:46.477899 (+ 1080us) server_negotiation.cc:299] Negotiation successful
0808 08:39:46.481273 (+ 3374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 08:39:46.501837 30471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52: Bootstrap starting.
I20260808 08:39:46.503126 30557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:46.417426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52176 (local address 127.5.164.252:37485)
0808 08:39:46.417598 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.417603 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.437053 (+ 19450us) server_negotiation.cc:407] Connection header received
0808 08:39:46.438108 (+ 1055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.438117 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.438226 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.438341 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.445734 (+ 7393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.447238 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.461181 (+ 13943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:46.461947 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:46.462130 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:46.493300 (+ 31170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 08:39:46.493308 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 08:39:46.493312 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 08:39:46.493363 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0808 08:39:46.498191 (+ 4828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.499797 (+ 1606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.499805 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.499810 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.499986 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 08:39:46.500771 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 08:39:46.500776 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 08:39:46.500780 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 08:39:46.501192 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 08:39:46.501503 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:46.502502 (+ 999us) server_negotiation.cc:299] Negotiation successful
0808 08:39:46.502747 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 08:39:46.511715 30471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52: Neither blocks nor log segments found. Creating new log.
I20260808 08:39:46.518052 30596 mvcc.cc:205] Tried to move back new op lower bound from 7316186670904524800 to 7316186670708936704. Current Snapshot: MvccSnapshot[applied={T|T < 7316186670904524800}]
I20260808 08:39:46.527817 30579 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "863539e3dbb5412db87d41881076782d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } } }
I20260808 08:39:46.528105 30579 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:39:46.529484 30471 log.cc:824] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52: Log is configured to *not* fsync() on all Append() calls
I20260808 08:39:46.536514 30471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52: No bootstrap required, opened a new log
I20260808 08:39:46.541172 30582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "863539e3dbb5412db87d41881076782d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } } }
I20260808 08:39:46.541649 30582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [sys.catalog]: This master's current role is: LEADER
I20260808 08:39:46.543431 30586 catalog_manager.cc:1347] Generated new cluster ID: d89987346dd0436e94995e69b13a4a96
I20260808 08:39:46.543617 30586 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 08:39:46.571904 30471 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } }
I20260808 08:39:46.572708 30471 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86092287932843dfa30859deb678ef52, State: Initialized, Role: FOLLOWER
I20260808 08:39:46.573496 30471 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } }
I20260808 08:39:46.597662 30586 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 08:39:46.600301 30586 catalog_manager.cc:1504] Loading token signing keys...
I20260808 08:39:46.605762 30604 catalog_manager.cc:1259] Loaded cluster ID: d89987346dd0436e94995e69b13a4a96
I20260808 08:39:46.605860 30604 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed: loading cluster ID for follower catalog manager: success
I20260808 08:39:46.609684 30604 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed: acquiring CA information for follower catalog manager: success
W20260808 08:39:46.611191 30604 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260808 08:39:46.588838 30480 master_runner.cc:186] Error getting master registration for 127.5.164.253:40279: OK, instance_id { permanent_uuid: "86092287932843dfa30859deb678ef52" instance_seqno: 1786178385699308 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 08:39:46.615729 30605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } } }
I20260808 08:39:46.616118 30605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:39:46.616950 30586 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d: Generated new TSK 0
I20260808 08:39:46.617980 30471 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 08:39:46.618075 30586 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 08:39:46.619066 30445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "863539e3dbb5412db87d41881076782d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "86092287932843dfa30859deb678ef52"
I20260808 08:39:46.619642 30445 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52 [term 0 FOLLOWER]: Advancing to term 1
I20260808 08:39:46.615011 30480 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 08:39:46.623607 30445 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 863539e3dbb5412db87d41881076782d in term 1.
I20260808 08:39:46.624536 30444 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52 [term 1 FOLLOWER]: Refusing update from remote peer 863539e3dbb5412db87d41881076782d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 08:39:46.625600 30582 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [LEADER]: Connected to new peer: Peer: permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 08:39:46.681294 30613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "863539e3dbb5412db87d41881076782d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } } }
I20260808 08:39:46.681823 30613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:39:46.681295 30605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 863539e3dbb5412db87d41881076782d. Latest consensus state: current_term: 1 leader_uuid: "863539e3dbb5412db87d41881076782d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } } }
I20260808 08:39:46.682331 30605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 08:39:46.744679 30629 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260808 08:39:46.760100 30558 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:46.751054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46016 (local address 127.5.164.254:39389)
0808 08:39:46.751279 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.751286 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.758026 (+ 6740us) server_negotiation.cc:407] Connection header received
0808 08:39:46.758321 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.758329 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.758415 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.758490 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.759805 (+ 1315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46016: BlockingRecv error: recv got EOF from 127.0.0.1:46016 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260808 08:39:46.762472 30560 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:46.757295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60452 (local address 127.5.164.253:40279)
0808 08:39:46.757474 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.757482 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.760841 (+ 3359us) server_negotiation.cc:407] Connection header received
0808 08:39:46.761079 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.761085 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.761180 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.761250 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.762239 (+ 989us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60452: BlockingRecv error: recv got EOF from 127.0.0.1:60452 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 08:39:46.764941 30557 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:46.760627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52184 (local address 127.5.164.252:37485)
0808 08:39:46.760818 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.760824 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.763406 (+ 2582us) server_negotiation.cc:407] Connection header received
0808 08:39:46.763703 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.763713 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.763802 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.763909 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.764669 (+ 760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52184: BlockingRecv error: recv got EOF from 127.0.0.1:52184 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260808 08:39:46.771693 30560 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:46.769657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60460 (local address 127.5.164.253:40279)
0808 08:39:46.769837 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.769843 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.770181 (+ 338us) server_negotiation.cc:407] Connection header received
0808 08:39:46.770392 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.770398 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.770551 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.770661 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.771465 (+ 804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60460: BlockingRecv error: recv got EOF from 127.0.0.1:60460 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 08:39:46.788334 30560 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:46.785963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60476 (local address 127.5.164.253:40279)
0808 08:39:46.786225 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.786234 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.786813 (+ 579us) server_negotiation.cc:407] Connection header received
0808 08:39:46.787041 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.787047 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.787188 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.787287 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.788060 (+ 773us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60476: BlockingRecv error: recv got EOF from 127.0.0.1:60476 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
W20260808 08:39:46.796062 30560 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:46.793904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60480 (local address 127.5.164.253:40279)
0808 08:39:46.794123 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.794132 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.794666 (+ 534us) server_negotiation.cc:407] Connection header received
0808 08:39:46.794877 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.794883 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.794965 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.795081 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.795824 (+ 743us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60480: BlockingRecv error: recv got EOF from 127.0.0.1:60480 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260808 08:39:46.805271 30560 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:46.803120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60494 (local address 127.5.164.253:40279)
0808 08:39:46.803413 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.803422 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.803894 (+ 472us) server_negotiation.cc:407] Connection header received
0808 08:39:46.804115 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.804119 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.804185 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.804293 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.805012 (+ 719us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60494: BlockingRecv error: recv got EOF from 127.0.0.1:60494 (error 108)
Metrics: {"server-negotiator.queue_time_us":146}
W20260808 08:39:46.825388 30560 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:46.823186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60496 (local address 127.5.164.253:40279)
0808 08:39:46.823421 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.823430 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.824017 (+ 587us) server_negotiation.cc:407] Connection header received
0808 08:39:46.824233 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.824243 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.824326 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.824432 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.825171 (+ 739us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60496: BlockingRecv error: recv got EOF from 127.0.0.1:60496 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260808 08:39:46.847371 30560 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:46.844986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60502 (local address 127.5.164.253:40279)
0808 08:39:46.845232 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.845243 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.845796 (+ 553us) server_negotiation.cc:407] Connection header received
0808 08:39:46.846039 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.846044 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.846131 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.846244 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.847055 (+ 811us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60502: BlockingRecv error: recv got EOF from 127.0.0.1:60502 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260808 08:39:46.885346 30560 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:46.882974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60518 (local address 127.5.164.253:40279)
0808 08:39:46.883247 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.883256 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.883805 (+ 549us) server_negotiation.cc:407] Connection header received
0808 08:39:46.884047 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.884058 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.884136 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.884268 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.885085 (+ 817us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60518: BlockingRecv error: recv got EOF from 127.0.0.1:60518 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260808 08:39:46.955487 30560 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:46.953082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60522 (local address 127.5.164.253:40279)
0808 08:39:46.953344 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:46.953353 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:46.953951 (+ 598us) server_negotiation.cc:407] Connection header received
0808 08:39:46.954194 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:46.954199 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:46.954276 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:46.954390 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:46.955240 (+ 850us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60522: BlockingRecv error: recv got EOF from 127.0.0.1:60522 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
W20260808 08:39:47.101723 30560 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:47.099600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60528 (local address 127.5.164.253:40279)
0808 08:39:47.099823 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:47.099829 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:47.100153 (+ 324us) server_negotiation.cc:407] Connection header received
0808 08:39:47.100401 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:47.100408 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:47.100528 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:47.100669 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:47.101470 (+ 801us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60528: BlockingRecv error: recv got EOF from 127.0.0.1:60528 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 08:39:47.109498 30582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "863539e3dbb5412db87d41881076782d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "863539e3dbb5412db87d41881076782d" member_type: VOTER last_known_addr { host: "127.5.164.254" port: 39389 } } peers { permanent_uuid: "86092287932843dfa30859deb678ef52" member_type: VOTER last_known_addr { host: "127.5.164.253" port: 40279 } } peers { permanent_uuid: "5c00dfe762f545988dc95d959cc586ed" member_type: VOTER last_known_addr { host: "127.5.164.252" port: 37485 } } }
I20260808 08:39:47.109834 30582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 863539e3dbb5412db87d41881076782d [sys.catalog]: This master's current role is: LEADER
W20260808 08:39:47.366640 30560 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 08:39:47.364649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60534 (local address 127.5.164.253:40279)
0808 08:39:47.364885 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:47.364892 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:47.365116 (+ 224us) server_negotiation.cc:407] Connection header received
0808 08:39:47.365371 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:47.365375 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:47.365452 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:47.365562 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 08:39:47.366353 (+ 791us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60534: BlockingRecv error: recv got EOF from 127.0.0.1:60534 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 08:39:47.614040 30604 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5c00dfe762f545988dc95d959cc586ed: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:39:47.749419 30629 catalog_manager.cc:1259] Loaded cluster ID: d89987346dd0436e94995e69b13a4a96
I20260808 08:39:47.749581 30629 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52: loading cluster ID for follower catalog manager: success
I20260808 08:39:47.752172 30629 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52: acquiring CA information for follower catalog manager: success
I20260808 08:39:47.753945 30629 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 86092287932843dfa30859deb678ef52: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 08:39:47.896679 30692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:47.889322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59428 (local address 127.5.164.253:40279)
0808 08:39:47.890194 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:47.890201 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:47.890223 (+ 22us) server_negotiation.cc:407] Connection header received
0808 08:39:47.890307 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:47.890312 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:47.890522 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:47.890673 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:39:47.891166 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:47.892397 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:47.893900 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:47.894608 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:47.894758 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:47.895267 (+ 509us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:39:47.896040 (+ 773us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:39:47.896187 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:47.896246 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 08:39:47.896335 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":729,"thread_start_us":590,"threads_started":1}
I20260808 08:39:47.909838 30698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:47.902878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54982 (local address 127.5.164.252:37485)
0808 08:39:47.903797 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:47.903804 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:47.903824 (+ 20us) server_negotiation.cc:407] Connection header received
0808 08:39:47.903992 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:47.903999 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:47.904200 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:47.904377 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:39:47.904724 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:47.905884 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:47.907319 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:47.907954 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:47.908076 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:47.908528 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:39:47.909204 (+ 676us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:39:47.909360 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:47.909408 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 08:39:47.909490 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":793,"thread_start_us":283,"threads_started":1}
I20260808 08:39:47.931697 30692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:47.916369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59440 (local address 127.5.164.253:40279)
0808 08:39:47.916545 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:47.916553 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:47.923610 (+ 7057us) server_negotiation.cc:407] Connection header received
0808 08:39:47.923964 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:47.923974 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:47.924096 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:47.924175 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:39:47.925116 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:47.926622 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:47.929232 (+ 2610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:47.929995 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:47.930123 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:47.930841 (+ 718us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:39:47.930969 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:39:47.931031 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:47.931303 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 08:39:47.931395 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 08:39:47.935426 30698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:47.916221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54996 (local address 127.5.164.252:37485)
0808 08:39:47.916376 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:47.916382 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:47.928750 (+ 12368us) server_negotiation.cc:407] Connection header received
0808 08:39:47.929225 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:47.929232 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:47.929360 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:47.929424 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:39:47.930204 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:47.931317 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:47.933526 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:47.934029 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:47.934102 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:47.934619 (+ 517us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:39:47.934728 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:39:47.934830 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:47.934999 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 08:39:47.935077 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 08:39:47.940207 30704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 08:39:47.916030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51326 (local address 127.5.164.254:39389)
0808 08:39:47.933969 (+ 17939us) server_negotiation.cc:206] Beginning negotiation
0808 08:39:47.933975 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 08:39:47.933998 (+ 23us) server_negotiation.cc:407] Connection header received
0808 08:39:47.934112 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 08:39:47.934117 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 08:39:47.934364 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 08:39:47.934553 (+ 189us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 08:39:47.935433 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:47.936570 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:47.937894 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 08:39:47.938525 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 08:39:47.938662 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 08:39:47.939101 (+ 439us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 08:39:47.939580 (+ 479us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 08:39:47.939705 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 08:39:47.939811 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 08:39:47.939896 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17807,"thread_start_us":19235,"threads_started":1}
I20260808 08:39:47.944797 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 30321
I20260808 08:39:47.945851 30390 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:39:48.060487 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 30321
I20260808 08:39:48.092509 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 30402
I20260808 08:39:48.093801 30466 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:39:48.215225 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 30402
I20260808 08:39:48.239017 5779 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu pid 30480
I20260808 08:39:48.240248 30546 generic_service.cc:196] Checking for leaks (request via RPC)
I20260808 08:39:48.348001 5779 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskp0Id9M/build/asan/bin/kudu with pid 30480
2026-08-08T08:39:48Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5204 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10403 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (383789 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST